Politics

/

ArcaMax

F.D. Flam: AI can debunk conspiracy theories better than humans

F.D. Flam, Bloomberg Opinion on

Published in Op Eds

Scientists surprised themselves when they found they could instruct a version of ChatGPT to gently dissuade people of their beliefs in conspiracy theories — such as notions that COVID-19 was a deliberate attempt at population control or that 9/11 was an inside job.

The most important revelation wasn’t about the power of AI, but about the workings of the human mind. The experiment punctured the popular myth that we’re in a post-truth era where evidence no longer matters, and it flew in the face of a prevailing view in psychology that people cling to conspiracy theories for emotional reasons and that no amount of evidence can ever disabuse them.

“It’s really the most uplifting research I’ve ever I done,” said psychologist Gordon Pennycook of Cornell University and one of the authors of the study. Study subjects were surprisingly amenable to evidence when it was presented the right way.

The researchers asked more than 2,000 volunteers to interact with a chatbot — GPT-4 Turbo, a large-language model — about beliefs that might be considered conspiracy theories. The subjects typed their belief into a box and the LLM would decide if it fit the researchers’ definition of a conspiracy theory. It asked participants to rate how sure they were of their beliefs on a scale of 0% to 100%. Then it asked the volunteers for their evidence.

The researchers had instructed the LLM to try to persuade people to reconsider their beliefs. To their surprise, it was actually pretty effective.

People’s faith in false conspiracy theories dropped 20%, on average. About a quarter of the volunteers dropped their belief level from above to below 50%. “I really didn't think it was going to work, because I really bought into the idea that, once you’re down the rabbit hole, there’s no getting out,” said Pennycook.

The LLM had some advantages over a human interlocutor. People who have strong beliefs in conspiracy theories tend to gather mountains of evidence — not quality evidence, but quantity. It’s hard for most non-believers to muster the motivation to do the tiresome work of keeping up. But AI can match believers with instant mountains of counter-evidence and can point out logical flaws in believers’ claims. It can react in real time to counterpoints the user might bring up.

Elizabeth Loftus, a psychologist at the University of California, Irvine, has been studying the power of AI to sow misinformation and even false memories. She was impressed with this study and the magnitude of the results. She considered that one reason it worked so well is that it’s showing the subjects how much information they didn’t know, and thereby reducing their overconfidence in their own knowledge. People who believe in conspiracy theories typically have a high regard for their own intelligence — and a lower regard for others’ judgment.

After the experiment, the researchers reported, some of the volunteers said it was the first time anyone, or anything, had really understood their beliefs and offered effective counter-evidence.

 

Before the findings were published this week in Science, the researchers made their version of the chatbot available to journalists to try out. I prompted it with beliefs I’ve heard from friends: that the government was covering up the existence of alien life, and that after the assassination attempt against Donald Trump, the mainstream press deliberately avoided saying he had been shot because reporters worried that it would help his campaign. And then, inspired by Trump’s debate comments, I asked the LLM if immigrants in Springfield, Ohio, were eating cats and dogs.

When I posed the UFO claim, I used the military pilot sightings and a National Geographic channel special as my evidence, and the chatbot pointed out some alternate explanations and showed why those were more probable than alien craft. It discussed the physical difficulty of traveling the vast space needed to get to Earth, and questioned whether it’s likely aliens could be advanced enough to figure this out yet clumsy enough to be discovered by the government.

On the question of journalists hiding Trump’s shooting, the AI explained that making guesses and stating them as facts is antithetical to a reporter’s job. If there’s a series of pops in a crowd, and it’s not yet clear what’s happening, that’s what they’re obligated to report — a series of pops. As for the Ohio pet-eating, the AI did a nice job of explaining that even if there were a single case of someone eating a pet, it wouldn’t demonstrate a pattern.

That’s not to say that lies, rumors and deception aren’t important tactics humans use to gain popularity and political advantage. Searching through social media after the recent presidential debate, many people believed the cat-eating rumor, and what they posted as evidence amounted to repetitions of the same rumor. To gossip is human.

But now we know they might be dissuaded with logic and evidence.

____

This column does not necessarily reflect the opinion of the editorial board or Bloomberg LP and its owners.

F.D. Flam is a Bloomberg Opinion columnist covering science. She is host of the “Follow the Science” podcast.


©2024 Bloomberg L.P. Visit bloomberg.com/opinion. Distributed by Tribune Content Agency, LLC.

 

Comments

blog comments powered by Disqus

 

Related Channels

ACLU

ACLU

By The ACLU
Amy Goodman

Amy Goodman

By Amy Goodman
Armstrong Williams

Armstrong Williams

By Armstrong Williams
Austin Bay

Austin Bay

By Austin Bay
Ben Shapiro

Ben Shapiro

By Ben Shapiro
Betsy McCaughey

Betsy McCaughey

By Betsy McCaughey
Bill Press

Bill Press

By Bill Press
Bonnie Jean Feldkamp

Bonnie Jean Feldkamp

By Bonnie Jean Feldkamp
Cal Thomas

Cal Thomas

By Cal Thomas
Christine Flowers

Christine Flowers

By Christine Flowers
Clarence Page

Clarence Page

By Clarence Page
Danny Tyree

Danny Tyree

By Danny Tyree
David Harsanyi

David Harsanyi

By David Harsanyi
Debra Saunders

Debra Saunders

By Debra Saunders
Dennis Prager

Dennis Prager

By Dennis Prager
Dick Polman

Dick Polman

By Dick Polman
Erick Erickson

Erick Erickson

By Erick Erickson
Froma Harrop

Froma Harrop

By Froma Harrop
Jacob Sullum

Jacob Sullum

By Jacob Sullum
Jamie Stiehm

Jamie Stiehm

By Jamie Stiehm
Jeff Robbins

Jeff Robbins

By Jeff Robbins
Jessica Johnson

Jessica Johnson

By Jessica Johnson
Jim Hightower

Jim Hightower

By Jim Hightower
Joe Conason

Joe Conason

By Joe Conason
Joe Guzzardi

Joe Guzzardi

By Joe Guzzardi
John Micek

John Micek

By John Micek
John Stossel

John Stossel

By John Stossel
Josh Hammer

Josh Hammer

By Josh Hammer
Judge Andrew Napolitano

Judge Andrew Napolitano

By Judge Andrew P. Napolitano
Laura Hollis

Laura Hollis

By Laura Hollis
Marc Munroe Dion

Marc Munroe Dion

By Marc Munroe Dion
Michael Barone

Michael Barone

By Michael Barone
Michael Reagan

Michael Reagan

By Michael Reagan
Mona Charen

Mona Charen

By Mona Charen
Oliver North and David L. Goetsch

Oliver North and David L. Goetsch

By Oliver North and David L. Goetsch
R. Emmett Tyrrell

R. Emmett Tyrrell

By R. Emmett Tyrrell
Rachel Marsden

Rachel Marsden

By Rachel Marsden
Rich Lowry

Rich Lowry

By Rich Lowry
Robert B. Reich

Robert B. Reich

By Robert B. Reich
Ruben Navarrett Jr

Ruben Navarrett Jr

By Ruben Navarrett Jr.
Ruth Marcus

Ruth Marcus

By Ruth Marcus
S.E. Cupp

S.E. Cupp

By S.E. Cupp
Salena Zito

Salena Zito

By Salena Zito
Star Parker

Star Parker

By Star Parker
Stephen Moore

Stephen Moore

By Stephen Moore
Susan Estrich

Susan Estrich

By Susan Estrich
Ted Rall

Ted Rall

By Ted Rall
Terence P. Jeffrey

Terence P. Jeffrey

By Terence P. Jeffrey
Tim Graham

Tim Graham

By Tim Graham
Tom Purcell

Tom Purcell

By Tom Purcell
Veronique de Rugy

Veronique de Rugy

By Veronique de Rugy
Victor Joecks

Victor Joecks

By Victor Joecks
Wayne Allyn Root

Wayne Allyn Root

By Wayne Allyn Root

Comics

Jimmy Margulies Rick McKee David M. Hitch Jeff Koterba Dave Granlund Ed Gamble