Top AI photo generators produce misleading election-related images, study finds

Leading artificial intelligence image generators can be manipulated into creating misleading election-related images, according to a report released Wednesday by tech watchdog the Center for Countering Digital Hate.

Leading artificial intelligence image generators can be manipulated into creating misleading election-related images, according to a report released Wednesday by tech watchdog the Center for Countering Digital Hate. The findings suggest that despite pledges from leading AI firms to address risks related to potential political misinformation ahead of elections in the United States and dozens of other countries this year, some companies still have work to do to ensure their AI tools cannot be manipulated to create misleading images. CCDH researchers tested AI image generators Midjourney, Stability AI’s DreamStudio, OpenAI’s ChatGPT Plus and Microsoft Image Creator. They found that each tool could be prompted to create misleading images related to either US presidential candidates or voting security. “Although these tools make some effort at content moderation, the existing protections are inadequate,” the group said in the report. “With the ease of access and minimal entry barriers provided by these platforms, virtually anyone can generate and disseminate election disinformation.” A spokesperson for Stability AI, which owns DreamStudio, told CNN that it updated its policies on March 1 to explicitly prohibit “generating, promoting, or furthering fraud or the creation or promotion of disinformation” and that the policy is in the process of being implemented. “We strictly prohibit the unlawful use of our models and technology, and the creation and misuse of misleading content,” the spokesperson said in an emailed statement, adding that the company has implemented various tools to prevent misuse. DreamStudio uses digital watermarking technology to help make its AI-generated images identifiable. Midjourney Founder David Holz told CNN in an email that the company’s “moderation systems are constantly evolving. Updates related specifically to the upcoming US election are coming soon.”