@rohanpaul_ai: This Nature Medicine published study has a strong warning for AI in healthcare. Frontier AI in healthcare has a hidden …

X AI KOLs Following News

Summary

A Nature Medicine study warns that frontier AI models in healthcare appear medically brilliant but are clinically unready, failing under stress tests that alter questions or remove inputs. The study emphasizes that benchmark success does not equal clinical readiness.

This Nature Medicine published study has a strong warning for AI in healthcare. Frontier AI in healthcare has a hidden failure mode: it can look medically brilliant while being clinically unready. The authors tested frontier AI models on health benchmarks, then added stress tests to see whether the models were actually robust or just good at passing exams. Found that the models were brittle. i.e the models could give the right answer in a normal test, but fail when the question was slightly changed, when important information was removed, or when the image-text setup was altered. One strange result was that some models could still guess the correct answer even when key inputs were removed, which suggests they may be using shortcuts rather than truly understanding the medical case. the models sometimes gave convincing explanations that sounded medical and logical, but the reasoning was flawed. The final conclusion is not “AI is useless in medicine” but that "benchmark success is not the same as clinical readiness.”
Original Article
View Cached Full Text

Cached at: 07/06/26, 06:02 AM

This Nature Medicine published study has a strong warning for AI in healthcare.

Frontier AI in healthcare has a hidden failure mode: it can look medically brilliant while being clinically unready.

The authors tested frontier AI models on health benchmarks, then added stress tests to see whether the models were actually robust or just good at passing exams.

Found that the models were brittle.

i.e the models could give the right answer in a normal test, but fail when the question was slightly changed, when important information was removed, or when the image-text setup was altered.

One strange result was that some models could still guess the correct answer even when key inputs were removed, which suggests they may be using shortcuts rather than truly understanding the medical case.

the models sometimes gave convincing explanations that sounded medical and logical, but the reasoning was flawed.

The final conclusion is not “AI is useless in medicine” but that “benchmark success is not the same as clinical readiness.”

Robotic fingers are progressing faster than we think.

Here, motors embedded in the fingers, onboard actuators inside each finger segment, in this Wuji Tech robot hands created this smooth multi-joint movements.

Similar Articles

Introducing HealthBench

OpenAI Blog

OpenAI introduces HealthBench, a new benchmark for evaluating AI systems in healthcare contexts, created with 262 physicians across 60 countries. The benchmark includes 5,000 realistic health conversations with physician-written rubrics to assess model performance on meaningful, trustworthy, and improvable metrics.

Frontier risk and preparedness

OpenAI Blog

OpenAI announced the winners of its Preparedness Challenge, which identified unique risks associated with frontier AI systems. The top ten submissions highlighted concerns including financial system manipulation, information leakage, medical harm, cyberattacks, and persuasion-based threats, with 70% of entries emphasizing AI's potential to enhance malicious persuasion capabilities.