flâneur

Janus' Simulators

astralcodexten.substack.com · 2,108 words · saved by 2 readers

This post isn't exactly about AI, but bear with me

This post isn’t exactly about AI. But the first three parts will be kind of technical AI stuff, so bear with me. Janus writes about Simulators. In the early 2000s, the early AI alignment pioneers - Eliezer Yudkowsky, Nick Bostrom, etc - deliberately started the field in the absence of AIs worth aligning. After powerful AIs existed and needed aligning, it might be too late. But they could glean some basic principles through armchair speculation and give their successors a vital head start. Without knowing how future AIs would work, they speculated on three potential motivational systems:…

saved by

related reading