✳flâneur — a map of the web's best reading
Sequent: Scale and Automation for Higher Confidence in Alignment — Sequent
sequent.org · 3,422 words · saved by 3 readers
Sequent founding announcement.
Alignment is not on track Artificial superintelligence (ASI) may be developed in the next few years. It is unclear whether alignment is on track to be ready on the same timeframe. At a minimum, the empirical programs at AI labs are unlikely to deliver a priori confidence, before training ASI, that things will go well. We are starting a large nonprofit research organization, Sequent, that aims to clear a higher bar: We are aiming at higher confidence via a portfolio of theory and empirics bets, all of which could fail, such that if any succeed, they would give us more a priori confidence in ali
Explore this link on the map →saved by
related reading
- Sequent: scale and automation for higher confidence in alignment — AI Alignment Forumalignmentforum.org
- PSA: Almost nobody is directly working on superintelligent alignment — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- LessWronglesswrong.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- Automated Alignment is Harder Than You Think — LessWronglesswrong.com
- OpenAI Launches Superalignment Taskforcethezvi.substack.com
- Short Timelines Don't Devalue Long Horizon Research — LessWronglesswrong.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- A minimal viable product for alignment - by Jan Leikealigned.substack.com