Predictive Data Debugging: Reveal and Shape What Your Model Learns, Before You Train - Goodfire

We introduce predictive data debugging: given a preference dataset, we can accurately predict which behaviors RL will amplify or suppress before you train, trace them back to the responsible data, and reshape the dataset and/or training process to prevent undesired effects.

saved by

• Ishaan Panigrahi