Shaping and Monitoring Models Through Their Internal Representations - Goodfire
goodfire.com · saved by 1 readers
We currently reward AI models for succeeding in training, but don’t specify how they should get there – leading to misgeneralization and misalignment. Our latest paper introduces mechanistic shaping, a way to teach models to be “right for the right reasons”, and studies its effects on monitorability.