Safety cases at AISI | AISI Work
As a complement to our empirical evaluations of frontier AI models, AISI is planning a series of collaborations and research projects sketching safety cases for more advanced models than exist today, focusing on risks from loss of control and autonomy. By a safety case, we mean a structured argument that an AI system is safe within a particular training or deployment context.
Note to readers: we changed our name to the AI Security Institute on 14 February 2025. Read more here. Safety cases: structured arguments for frontier AI safety The benefits and risks posed by frontier AI models are changing over time as performance increases, requiring corresponding changes to how we mitigate those risks and the evidence required to trust those mitigations. Existing models lack the capabilities required to pose certain severe risks such as irreversible loss of human control, so arguments based on capabilities evaluations suffice. If future models are much more capable then di
Explore this link on the map →related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- AI in 2025: gestalt — LessWronglesswrong.com
- Emerging processes for frontier AI safety - GOV.UKgov.uk
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- AI safety - Wikipediaen.wikipedia.org
- AI Safety | Arkosevictoriabrook.github.io
- Thoughts on the conservative assumptions in AI controlblog.redwoodresearch.org
- AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
- Three Sketches of ASL-4 Safety Case Componentsalignment.anthropic.com