AI Tools for Existential Security | Forethought
Humanity is not prepared for the AI-driven challenges we face. But the right AI tools could help us to anticipate and work together to meet these challenges — if they’re available in time. We can and should accelerate these tools. Key applications include (1) *epistemic* tools, which improve human judgement; (2) *coordination* tools, which help diverse groups work identify and work towards shared goals; (3) *risk-targeted* tools to address specific challenges. We can accelerate important tools by investing in task-relevant data, lowering adoption barriers, and securing compute for key R&D. While background AI progress limits potential gains, even small speedups could be decisive. This is a priority area. There is lots to do already, and there will quickly be more. We should get started, and we should plan for a world with abundant cognition.
AI Tools for Existential Security Lizka Vaintrob Owen Cotton-Barratt Authors Citations Cite Citations PDF Contact 14th March 2025 AI Tools for Existential Security Executive summary Implications Some AI applications will help navigate existential risks Epistemic applications Coordination-enabling applications Risk-targeted applications Other applications? We can accelerate helpful AI tools There’s meaningful room to accelerate some applications There are promising strategies for accelerating specific AI applications Implications for work on existential risk reduction 1. Shift towards accelerat
saved by
related reading
- Existential Risk from AI: An Exposition for Mathematiciansalkjash.github.io
- AI Resilienceairesilience.net
- Ten AI safety projects I'd like people to work onthirdthing.ai
- AI Futurism Reading Listblog.redwoodresearch.org
- The Artificiality of Alignmentjoinreboot.org
- Cognitive Security as an AI Safety Cause Area — LessWronglesswrong.com
- AI for Decision Adviceforethought.org
- Preparing for the Intelligence Explosionforethought.org
- A Long Sequence of Small, Correct Decisionscalebwatney.substack.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Existential risk, AI, and the inevitable turn in human history - Marginal REVOLUTIONmarginalrevolution.com
- Notes on Existential Risk from Artificial Superintelligencemichaelnotebook.com