Alignment Forecasting: Predicting Misalignment from Training Data — LessWrong
lesswrong.com · saved by 1 readers
Fine-tuning on subtly flawed data can make a model broadly misaligned. Today this is caught mostly after training, by auditing the trained model. We…