For almost 30 years, Oren Etzioni was among the most optimistic artificial intelligence researchers.
But in 2019, Dr. Etzioni, a professor at the University of Washington and founding executive director of the Allen Institute for AI, became one of the first researchers to warn that a new generation of AI would accelerate the spread of misinformation online. And in the middle of last year, he said, he was concerned that AI-generated deepfakes could influence an important election. In January he founded a nonprofit, TrueMedia.org, hoping to combat that threat.
On Tuesday, the organization launched free tools to identify digital misinformation, with a plan to put them in the hands of journalists, fact-checkers and anyone else trying to figure out what’s real online.
The tools, available on the TrueMedia.org website to anyone approved by the nonprofit, are designed to detect fake and manipulated images, audio and video. They review links to media files and quickly determine if they should be trusted.
Dr. Etzioni sees these tools as an improvement over the mosaic defense currently used to detect misleading or deceptive AI content. But in a year when billions of people around the world will vote in elections, he continues to paint a bleak picture of what lies ahead.
“I’m terrified,” he said. “There’s a good chance we’ll see a tsunami of misinformation.”
In just the first few months of the year, AI technologies helped create fake voice calls from President Biden, fake images and audio ads from Taylor Swift, and an entire fake interview that appeared to show a Ukrainian official taking credit of a terrorist attack in Moscow. Detecting this type of misinformation is already difficult, and the tech industry continues to release increasingly powerful artificial intelligence systems that will generate increasingly convincing deepfakes and make detection even more difficult.
Many artificial intelligence researchers warn that the threat is gaining strength. Last month, more than a thousand people, including Dr. Etzioni and several other prominent AI researchers, signed an open letter calling for laws that hold developers and distributors of AI visual and audio services liable if their technology is easily used to create harmful content. deepfakes.
At an event hosted by Columbia University on Thursday, Hillary Clinton, former secretary of state, interviewed Eric Schmidt, former CEO of Google, who warned that videos, even fake ones, could “drive voting behavior, human behavior.” , moods, everything.”
“I don’t think we’re prepared,” Schmidt said. “This problem is going to get much worse in the coming years. Maybe or not for November, but certainly in the next cycle.”
The technology industry is well aware of the threat. Even as companies rush to advance generative AI systems, they struggle to limit the damage these technologies can cause. Anthropic, Google, Meta and OpenAI have announced plans to limit or label election-related uses of their AI services. In February, 20 tech companies, including Amazon, Microsoft, TikTok and X, signed a voluntary pledge to prevent misleading AI content from disrupting voting.
That could be a challenge. Companies often release their technologies as “open source” software, meaning that anyone is free to use and modify them without restrictions. Experts say the technology used to create deepfakes – the result of huge investment by many of the world’s largest companies – will always outperform technology designed to detect disinformation.
Last week, during an interview with The New York Times, Dr. Etzioni showed how easy it is to create a deepfake. Using a service from a sister nonprofit organization, CivAI, which uses artificial intelligence tools available on the Internet to demonstrate the dangers of these technologies, he instantly created photos of himself in prison, in a place he has never been. state.
“When you see yourself being fooled, it’s a lot scarier,” he said.
He later generated a deepfake of himself in a hospital bed, the kind of image he believes could influence an election if applied to Biden or former President Donald J. Trump just before the election.
TrueMedia tools are designed to detect fakes like these. More than a dozen startups offer similar technology.
But Dr. Etzioni, while highlighting the effectiveness of his group’s tool, said no detector was perfect because they were driven by probabilities. Deepfake detection services have been tricked into declaring images of kissing robots and giant Neanderthals as real photographs, raising concerns that such tools could further damage society’s trust in facts and evidence.
When Dr. Etzioni fed TrueMedia’s tools a known deepfake of Mr. Trump sitting on a porch with a group of young black men, they labeled it “highly suspicious,” his highest level of confidence. When another well-known deepfake of Trump with blood on his fingers was uploaded, they weren’t “sure” if it was real or fake.
“Even using the best tools, you can’t be sure,” he said.
The Federal Communications Commission recently banned AI-generated robocalls. Some companies, including OpenAI and Meta, are now watermarking AI-generated images. And researchers are exploring additional ways to separate the real from the fake.
The University of Maryland is developing a QR code-based cryptographic system to authenticate unaltered live recordings. A study published last month asked dozens of adults to breathe, swallow and think while they spoke so they could compare their speech pause patterns to the rhythms of cloned audio.
But like many other experts, Dr. Etzioni warns that image watermarks are easily removed. And while he has dedicated his career to fighting deepfakes, he acknowledges that detection tools will have a hard time surpassing new generative AI technologies.
Since creating TrueMedia.org, OpenAI has introduced two new technologies that promise to make your job even harder. A person’s voice can be recreated from a 15-second recording. Another can generate full-motion videos that look like something straight out of a Hollywood movie. OpenAI is not yet sharing these tools with the public as it works to understand the potential dangers.
(The Times has sued OpenAI and its partner, Microsoft, over allegations of copyright infringement involving AI systems that generate text.)
Ultimately, Dr. Etzioni said, combating the problem will require broad cooperation between government regulators, companies that create artificial intelligence technologies, and the tech giants that control the web browsers and social networks where misinformation spreads. However, he said the likelihood of that happening before the fall election was slim.
“We’re trying to give people the best technical assessment of what’s in front of them,” he said. “They still have to decide if it’s real.”
