Medical AI Safety: We have a problem. – Lauren Oakden-Rayner
For the first time ever AI systems can directly harm patients. Are we doing enough to prevent a medical AI tragedy, the equivalent of a thalidomide event?
This is the start of a new blog series on the most important topic I will probably ever write about: medical AI safety . This is a timely discussion, because we are approaching a tipping point. For the first time ever AI systems are replacing human judgement in actual clinics. For the first time ever AI systems could directly harm patients, with unsafe systems leading to overspending, injury, or even death. For the first time ever, AI systems could actually be responsible for medical disasters . If that sounds ominous, it should. I don’t think we are being nearly careful enough. Medical
saved by
related reading
- Medical AI Safety: Doing it wrong. – Lauren Oakden-Raynerlaurenoakdenrayner.com
- Dario Amodei — Policy on the AI Exponentialdarioamodei.com
- Dario Amodei — We Must Pace the Frontierdarioamodei.com
- Why AI doctors should not require FDA regulationmoreisdifferent.substack.com
- AI Triage Safety: HealthBench & Emergency Escalation | Counsel Healthcounselhealth.com
- To Recommend or Not to Recommend: Designing and Evaluating AI-Enabled Decision Support for Time-Critical Medical Eventsarxiv.org
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- AI safety - Wikipediaen.wikipedia.org
- Here Are 3 AI Companies Betting They Can Replace Doctorsforbes.com
- Artificial intelligence in healthcare: transforming the practice of medicinepmc.ncbi.nlm.nih.gov
- AI for medicine is overhyped right now - by Dan Eltonmoreisdifferent.substack.com
- Systemic Bottlenecks & Misalignmentscurecancer.ai