Hidden Bias
Models trained on real-world data can encode real-world bias. Hiding information about protected classes doesn't always fix things — sometimes it can even hurt.
Hidden Bias Explorables Hidden Bias Models trained on real-world data can encode real-world bias. Hiding information about protected classes doesn't always fix things — sometimes it can even hurt. Modeling College GPA Let's pretend we're college admissions officers trying to predict the GPA students will have in college (in these examples we'll use simulated data). One simple approach: predict that students will have the same GPA in college as they did in high school. This is at best a very rough approximation, and it misses a key feature of this data set: students usually have better grades i
related reading
- Subliminal Learning: Language Models Transmit Behavioral Traits via Hidden Signals in Dataalignment.anthropic.com
- Scaling is subtler than it seemsberen.io
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- Can a Model Be Differentially Private and Fair?pair.withgoogle.com
- Datasets Have Worldviewspair.withgoogle.com
- Troubles with the Bias-Variance tradeoffejenner.com
- Biases: An Introductionreadthesequences.com
- Measuring Fairnesspair.withgoogle.com
- Auditing language models for hidden objectives — LessWronglesswrong.com
- Biasjzhao.xyz
- A Course in Machine Learningciml.info
- AI and prediction of criminal justice risk: revisiting the COMPAS dataset, experiments, and the problem of algorithmic bias and fairnesslink.springer.com