Politics

/

ArcaMax

Commentary: The crucial medical question that AI can't ever answer

James N. Weinstein and Ogan Gurel, Los Angeles Times on

Published in Op Eds

One of us got a call last spring from a longtime friend. The story was familiar: two doctors, an MRI, an online AI tool, a stack of articles — and one anxious question. “Everything tells me something different. The AI says I might need surgery. What should I do?”

We believe there’s one key response to anyone in this all-too-common conundrum: “What matters most to you?”

There was a long pause.

That pause is one of the most important moments in modern healthcare — and it is exactly the question artificial intelligence is unable to address.

In our careers as physicians and researchers, we have found, clearly and repeatedly, that for many common conditions the medical evidence does not point to a single “right” answer. The biology is often close. What determines the success of an outcome is whether the choice fits the person making it.

Some patients with back pain want the fastest possible return to physically demanding work, even if it means surgery. Others want to avoid an operation at almost any cost, even if recovery takes longer. The scan may look the same. The lives behind the scan are not.

That insight is becoming critically important as artificial intelligence moves deeper into everyday health decisions.

In our research on AI and clinical decision-making, we’ve studied what happens when systems are trained to optimize medical outcomes but are blind to human values. In plain English, today’s AI is very good at telling you what usually works for people like you with similar demographics and medical histories. It is far less capable of understanding what you are trying to protect, avoid or prioritize.

This matters because some of the most common and most expensive medical decisions are not purely biological. Should someone with low-risk prostate cancer choose surgery, radiation or careful monitoring? Should a person with atrial fibrillation undergo a procedure or manage the condition with medication? Should a patient with chronic knee or back pain operate now or try months of physical therapy to see whether surgery can be avoided?

In these situations, the medical differences between options are often small or uncertain. What makes the biggest difference is whether the treatment aligns with the patient’s goals: tolerance for risk, willingness to undergo recovery, ability to adhere to long-term therapy or simply what kind of life they want to live.

AI systems can calculate probabilities. They cannot determine what those probabilities mean to a particular person.

In some respects, artificial intelligence may know more medicine than any individual physician. It can synthesize millions of scientific papers, clinical studies and patient records in seconds. Yet it knows remarkably little about the person sitting across from it. AI does not know a patient’s goals, fears, obligations, tolerance for risk or personal definition of a good outcome. And because it knows little about either the patient or the physician, it knows even less about the conversation between them — the place where facts, values and trust come together to produce the right decision for a particular person.

A second patient story brought this home. A retired teacher was referred after an AI-based symptom checker flagged a heart rhythm abnormality and “favored” an invasive procedure. The patient arrived frightened, convinced there was one correct path. When we talked, it became clear that what mattered most was avoiding a long recovery and staying healthy enough to travel to see grandchildren.

Medication and monitoring — less dramatic, but well-supported by evidence — fit those goals better. The AI wasn’t wrong. It just didn’t know what mattered.

This blind spot is not trivial. Roughly a quarter of U.S. healthcare spending flows through decisions in which patient preferences meaningfully affect outcomes. When those preferences are ignored — by people or by algorithms — care becomes misaligned. That can mean unnecessary procedures, poor adherence, regret and rising costs without better health.

So what should consumers do when an app, portal or “smart” tool recommends a course of action?

 

Start with three questions.

First: “Best for whom?” If a tool says one option is best, ask whether it means best on average — or best for someone with your priorities.

Second: “What does this system not know about me?”

AI can see lab values and imaging results. It cannot see your job, your family responsibilities, your fears or what you are trying to get back to.

Advertisement

Third: “What happens if I wait or choose differently?”

Many important medical decisions are not emergencies. When options are close, taking time to reflect is often part of good care.

Artificial intelligence is becoming a powerful partner in medicine. It can help explain options, surface evidence and reduce confusion. But it should inform human decisions, not replace them.

AI may know more medicine than any physician.

It knows far less about any patient.

And it knows least about the conversation between them.

The most important variable in your healthcare is not in any algorithm. It is you.

____

James N. Weinstein is a surgeon and former chief executive of Dartmouth Health. He is a clinical professor at Northwestern University’s Kellogg School of Management and global head of Health Futures at Microsoft, which develops AI systems. Ogan Gurel is a physician and assistant professor at the University of Texas at Arlington, where he researches AI, causal inference and patient decision-making.


©2026 Los Angeles Times. Visit at latimes.com. Distributed by Tribune Content Agency, LLC.

 

Comments

blog comments powered by Disqus

 

Related Channels

The ACLU

ACLU

By The ACLU
Amy Goodman

Amy Goodman

By Amy Goodman
Armstrong Williams

Armstrong Williams

By Armstrong Williams
Austin Bay

Austin Bay

By Austin Bay
Ben Shapiro

Ben Shapiro

By Ben Shapiro
Betsy McCaughey

Betsy McCaughey

By Betsy McCaughey
Bill Press

Bill Press

By Bill Press
Bonnie Jean Feldkamp

Bonnie Jean Feldkamp

By Bonnie Jean Feldkamp
Cal Thomas

Cal Thomas

By Cal Thomas
Clarence Page

Clarence Page

By Clarence Page
Danny Tyree

Danny Tyree

By Danny Tyree
David Harsanyi

David Harsanyi

By David Harsanyi
Debra Saunders

Debra Saunders

By Debra Saunders
Dennis Prager

Dennis Prager

By Dennis Prager
Dick Polman

Dick Polman

By Dick Polman
Erick Erickson

Erick Erickson

By Erick Erickson
Froma Harrop

Froma Harrop

By Froma Harrop
Jacob Sullum

Jacob Sullum

By Jacob Sullum
Jamie Stiehm

Jamie Stiehm

By Jamie Stiehm
Jeff Robbins

Jeff Robbins

By Jeff Robbins
Jessica Johnson

Jessica Johnson

By Jessica Johnson
Jim Hightower

Jim Hightower

By Jim Hightower
Joe Conason

Joe Conason

By Joe Conason
John Stossel

John Stossel

By John Stossel
Josh Hammer

Josh Hammer

By Josh Hammer
Judge Andrew P. Napolitano

Judge Andrew Napolitano

By Judge Andrew P. Napolitano
Laura Hollis

Laura Hollis

By Laura Hollis
Marc Munroe Dion

Marc Munroe Dion

By Marc Munroe Dion
Michael Barone

Michael Barone

By Michael Barone
Mona Charen

Mona Charen

By Mona Charen
Rachel Marsden

Rachel Marsden

By Rachel Marsden
Rich Lowry

Rich Lowry

By Rich Lowry
Robert B. Reich

Robert B. Reich

By Robert B. Reich
Ruben Navarrett Jr.

Ruben Navarrett Jr

By Ruben Navarrett Jr.
Ruth Marcus

Ruth Marcus

By Ruth Marcus
S.E. Cupp

S.E. Cupp

By S.E. Cupp
Salena Zito

Salena Zito

By Salena Zito
Star Parker

Star Parker

By Star Parker
Stephen Moore

Stephen Moore

By Stephen Moore
Susan Estrich

Susan Estrich

By Susan Estrich
Ted Rall

Ted Rall

By Ted Rall
Terence P. Jeffrey

Terence P. Jeffrey

By Terence P. Jeffrey
Tim Graham

Tim Graham

By Tim Graham
Tom Purcell

Tom Purcell

By Tom Purcell
Veronique de Rugy

Veronique de Rugy

By Veronique de Rugy
Victor Joecks

Victor Joecks

By Victor Joecks
Wayne Allyn Root

Wayne Allyn Root

By Wayne Allyn Root

Comics

Ratt Joey Weatherford David Horsey Andy Marlette Marshall Ramsey Jeff Koterba