Medical AI Safety: We have a problem. – Lauren Oakden-Rayner
For the first time ever AI systems can directly harm patients. Are we doing enough to prevent a medical AI tragedy, the equivalent of a thalidomide event?
This is the start of a new blog series on the most important topic I will probably ever write about: medical AI safety . This is a timely discussion, because we are approaching a tipping point. For the first time ever AI systems are replacing human judgement in actual clinics. For the first time ever AI systems could directly harm patients, with unsafe systems leading to overspending, injury, or even death. For the first time ever, AI systems could actually be responsible for medical disasters . If that sounds ominous, it should. I don’t think we are being nearly careful enough. Medical
saved by
related reading
- Medical AI Safety: Doing it wrong. – Lauren Oakden-Raynerlaurenoakdenrayner.com
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- AI for medicine is overhyped right now - by Dan Eltonmoreisdifferent.substack.com
- Why AI Will Save the World | Andreessen Horowitza16z.com
- The Only Way to Deal With the Threat From AI? Shut It Downtime.com
- AI Safety Seems Hard to Measurecold-takes.com
- Why AI risks are the world’s most pressing problems | 80,000 Hours80000hours.org
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Racing through a minefield: the AI deployment problemcold-takes.com
- Artificial intelligence in healthcare: transforming the practice of medicinepmc.ncbi.nlm.nih.gov
- AI models can be dangerous before public deploymentmetr.org
- Brain dump on the diversity of AI risk | Jascha’s blogsohl-dickstein.github.io