An Overview of the AI Safety Funding Situation — LessWrong
AI safety is a field concerned with preventing negative outcomes from AI systems and ensuring that AI is beneficial to humanity. The field does research on problems such as the AI alignment problem which is the problem of designing AI systems that follow user intentions and behave in a desirable and beneficial way. Understanding and solving AI safety problems may involve reading past research, producing new research in the form of papers or posts, running experiments with ML models, and so on. Producing research typically involves many different inputs such as research staff, compute, equipment, and office space. These inputs all require funding and therefore funding is a crucial input for enabling or accelerating AI safety research. Securing funding is usually a prerequisite for starting or continuing AI safety research in industry, in an academic setting, or independently. There are many barriers that could prevent people from working on AI safety. Funding is one of them. Even if som
x An Overview of the AI Safety Funding Situation — LessWrong Community AI Personal Blog 74 An Overview of the AI Safety Funding Situation by Stephen McAleese 12th Jul 2023 18 min read 10 74 Note: this post was updated in January 2025 to reflect all available data from 2024. Introduction AI safety is a field concerned with preventing negative outcomes from AI systems and ensuring that AI is beneficial to humanity. The field does research on problems such as the AI alignment problem which is the problem of designing AI systems that follow user intentions and behave in a desirable and beneficial
Explore this link on the map →related reading
- AI safety undervalues founders — LessWronglesswrong.com
- Field map – AISafety.comaisafety.com
- It looks like there are some good funding opportunities in AI safety right now | 80,000 Hours80000hours.org
- The Anthropic IPO Is Coming. We Aren't Ready for It. — EA Forumforum.effectivealtruism.org
- Field map – AISafety.comaisafety.com
- How to Actually Spend Billions on AI Safety — EA Forumforum.effectivealtruism.org
- Ten AI safety projects I'd like people to work on — LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- AI safety technical research | Career review | 80,000 Hours80000hours.org
- 2020 AI Alignment Literature Review and Charity Comparison — EA Forumforum.effectivealtruism.org
- April 2019: Long-Term Future Fund Grants and Recommendations | Effective Altruism Fundsfunds.effectivealtruism.org