flâneur

Thousand-dimensional structure — Resolution

resolution.org · 2,858 words · saved by 3 readers

Finding and controlling the low-dimensional persona structure in models — from emergent misalignment and subliminal learning through to superintelligence.

Summary: One area we plan to explore at Resolution is personas and character training, operationalized as finding and controlling low-dimensional structure in models that emerges in pretraining and flows through post-training to superintelligence. The hope is to expand and systematize phenomena such as emergent misalignment, subliminal learning, and other empirical persona research, then intervene on this structure without accidentally hiding undesirable behavior elsewhere. Glimmers of low-dimensional structure Our understanding of AI training and alignment as a field is very poor. If…

saved by

related reading