Meta identifies networks pushing deceptive content likely generated by AI

Meta said it had found “likely AI-generated” content used deceptively on its Facebook and Instagram platforms.

Meta said on Wednesday it had found "likely AI-generated" content used deceptively on its Facebook and Instagram platforms, including comments praising Israel's handling of the war in Gaza published below posts from global news organisations and U.S. lawmakers.

The social media company, in a quarterly security report, said the accounts posed as Jewish students, African Americans and other concerned citizens, targeting audiences in the United States and Canada. It attributed the campaign to Tel Aviv-based political marketing firm STOIC.

STOIC did not immediately respond to a request for comment on the allegations.

(For top technology news of the day, subscribe to our tech newsletter Today’s Cache)

While Meta has found basic profile photos generated by artificial intelligence in influence operations since 2019, the report is the first to disclose the use of text-based generative AI technology since it emerged in late 2022.

Researchers have fretted that generative AI, which can quickly and cheaply produce human-like text, imagery and audio, could lead to more effective disinformation campaigns and sway elections.

In a press call, Meta security executives said they removed the Israeli campaign early and did not think novel AI technologies had impeded their ability to disrupt influence networks, which are coordinated attempts to push messages.