ALIGNMENT - by vincent huang - a slice of my mind
the first time we met, you told me how the rest of your life would play out. align the current language models (make sure they behave in line with human values), then use them to supervise the AGI, then use the AGI to build superintelligence. you declared that the purpose of your life was alignment research oh, i thought to myself, i wonder why you’re talking to me then i also worked on AI research, but in a different subfield. my job was to develop more efficient pipelining strategies for training models. i spent my days staring at GPU pipeline diagrams and thinking about how to transfer data around the network as efficiently as possible. on good weeks i thought it was the coolest job in the world - at its core it was just one massive scheduling puzzle, the most complex one i’d ever encountered, and i enjoyed the occasional detours into linear programs and graph theory and discrete math on bad weeks i’d implement new pipeline optimizations and debug them for days on end, only to reali
ALIGNMENT on dating an ai researcher vincent huang Jul 11, 2025 314 33 46 Share the first time we met, you told me how the rest of your life would play out. align the current language models (make sure they behave in line with human values), then use them to supervise the AGI, then use the AGI to build superintelligence . you declared that the purpose of your life was alignment research oh , i thought to myself, i wonder why you’re talking to me then i also worked on AI research, but in a different subfield. my job was to develop more efficient pipelining strategies for training models. i spen
Explore this link on the map →related reading
- ALIGNMENT - by vincent huang - a slice of my mindmindslice.substack.com
- ALIGNMENT - by vincent huang - a slice of my mindmindslice.substack.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- LessWronglesswrong.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- OpenAI Launches Superalignment Taskforcethezvi.substack.com
- Looking back on my alignment PhD — LessWronglesswrong.com
- What Does It Mean to Align AI With Human Values? | Quanta Magazinequantamagazine.org
- PSA: Almost nobody is directly working on superintelligent alignment — LessWronglesswrong.com
- Product Alignment is not Superintelligence Alignment (and we need the latter to survive) — LessWronglesswrong.com
- Can we safely automate alignment research? - Joe Carlsmithjoecarlsmith.com