Sequent: Scale and Automation for Higher Confidence in Alignment — Sequent
sequent.org · 3,422 words · saved by 3 readers
Sequent founding announcement.
Alignment is not on track Artificial superintelligence (ASI) may be developed in the next few years. It is unclear whether alignment is on track to be ready on the same timeframe. At a minimum, the empirical programs at AI labs are unlikely to deliver a priori confidence, before training ASI, that things will go well. We are starting a large nonprofit research organization, Sequent, that aims to clear a higher bar: We are aiming at higher confidence via a portfolio of theory and empirics bets, all of which could fail, such that if any succeed, they would give us more a priori confidence in ali
saved by
related reading
- Sequent: scale and automation for higher confidence in alignment — AI Alignment Forumalignmentforum.org
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- PSA: Almost nobody is directly working on superintelligent alignment — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- Automated Alignment is Harder Than You Think — LessWronglesswrong.com
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- OpenAI Launches Superalignment Taskforcethezvi.substack.com
- [2605.06390] Automated alignment is harder than you thinkarxiv.org