✳flâneur — a map of the web's best reading

Sequent: scale and automation for higher confidence in alignment — AI Alignment Forum

alignmentforum.org · 3,534 words · saved by 1 readers

Artificial superintelligence (ASI) may be developed in the next few years. It is unclear whether alignment is on track to be ready on the same timeframe. At a minimum, the empirical programs at AI labs are unlikely to deliver a priori confidence, before training ASI, that things will go well. We are starting a large nonprofit research organization, Sequent, that aims to clear a higher bar: Who[1]: researchers from the UK AISI’s Alignment Team and Timaeus, with more to come. We’re aiming at 40-80 FTE two years from now. The Alignment Team ran the £30m Alignment Project, and Timaeus has pioneered applying singular learning theory (SLT) to alignment. Founding team: Where: a large in-person presence in the Bay Area (Berkeley), as well as researchers working remotely from London, Melbourne, and elsewhere. In this post, we discuss: In an ideal world, we would develop an approach to building superintelligence together with a theoretical proof that it was safe, and then build it. In this world

x Sequent: scale and automation for higher confidence in alignment — AI Alignment Forum AI Personal Blog 2026 Top Fifty: 14 % 96 Sequent: scale and automation for higher confidence in alignment by Geoffrey Irving , Alex HT , Jesse Hoogland , Daniel Murfet , Jacob Pfau , Marco Cozzi , Stan van Wingerden 10th Jun 2026 Linkpost for sequent.org 14 min read 2 96 Alignment is not on track Artificial superintelligence (ASI) may be developed in the next few years. It is unclear whether alignment is on track to be ready on the same timeframe. At a minimum, the empirical programs at AI labs are unlikely

Explore this link on the map →

saved by

related reading