AI Tools for Existential Security | Forethought
Humanity is not prepared for the AI-driven challenges we face. But the right AI tools could help us to anticipate and work together to meet these challenges — if they’re available in time. We can and should accelerate these tools. Key applications include (1) *epistemic* tools, which improve human judgement; (2) *coordination* tools, which help diverse groups work identify and work towards shared goals; (3) *risk-targeted* tools to address specific challenges. We can accelerate important tools by investing in task-relevant data, lowering adoption barriers, and securing compute for key R&D. While background AI progress limits potential gains, even small speedups could be decisive. This is a priority area. There is lots to do already, and there will quickly be more. We should get started, and we should plan for a world with abundant cognition.
AI Tools for Existential Security Lizka Vaintrob Owen Cotton-Barratt Authors Citations Cite Citations PDF Contact 14th March 2025 AI Tools for Existential Security Executive summary Implications Some AI applications will help navigate existential risks Epistemic applications Coordination-enabling applications Risk-targeted applications Other applications? We can accelerate helpful AI tools There’s meaningful room to accelerate some applications There are promising strategies for accelerating specific AI applications Implications for work on existential risk reduction 1. Shift towards accelerat
Explore this link on the map →saved by
related reading
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Why AI risks are the world’s most pressing problems | 80,000 Hours80000hours.org
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Preparing for Launch | IFPifp.org
- Jobs that can help with the most important centurycold-takes.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Concrete Projects in AGI Preparednessforethought.org
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org
- AI x-risk, approximately ordered by embarrassment — LessWronglesswrong.com