Don’t use Americans’ data on the sly to train AI, FTC warns businesses

US companies may find themselves under federal scrutiny if they “quietly” try to funnel customers’ personal information into training artificial intelligence models, the government warned this week.

US companies may find themselves under federal scrutiny if they “quietly” try to funnel customers’ personal information into training artificial intelligence models, the government warned this week. The warning by the Federal Trade Commission, the nation’s top privacy and consumer protection agency, highlights the enormous value of Americans’ personal data. Troves of digital information already help Netflix determine what you might like to watch next, or help Amazon figure out what you’re likely to buy, or help Google understand what shops are nearby. Now, however, much of that same information could be fed into ever more sophisticated AI models amid the rush to adopt a hot new technology, the FTC wrote in a blog post Tuesday. “You may have heard that ‘data is the new oil,’” the agency said, referencing an adage describing the way personal information is a critical input powering the machinery of Big Tech. “There is perhaps no data refinery as large-capacity and as data-hungry as AI.” Many companies disclose how they use customer or user information in their privacy policies. But simply updating a privacy policy to say that a company will now use personal data collected for other purposes to train AI isn’t transparent enough and could violate the law, the FTC said. Consumer protection regulators won’t hesitate to crack down on companies “surreptitiously re-writing their privacy policies or terms of service to allow themselves free rein to use consumer data for product development,” the agency said. “Ultimately, there’s nothing intelligent about obtaining artificial consent.”