Séb Krier on X: "The way people discuss AI incidents is pretty important and I'm a bit concerned we're sleepwalking into a bad world littered with bad abstractions. How you label something is often a lossy compressions of a causal model, so the words you use affects which hypotheses people update https://t.co/IsMLwiMhR4" / X
The way people discuss AI incidents is pretty important and I'm a bit concerned we're sleepwalking into a bad world littered with bad abstractions. How you label something is often a lossy compressions of a causal model, so the words you use affects which hypotheses people update
Séb Krier @sebkrier The way people discuss AI incidents is pretty important and I'm a bit concerned we're sleepwalking into a bad world littered with bad abstractions. How you label something is often a lossy compressions of a causal model, so the words you use affects which hypotheses people update toward and by how much. Reward hacking has been known about for a long time, and is a serious problem with models - and I think this is the expression we should use when discussing stuff like the Hugging Face incident (assuming that was, in fact, a reward hacking incident). But some people will fre
Explore this link on the map →related reading
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Here's the exit. — LessWronglesswrong.com
- Dreams of AI alignment: The danger of suggestive names — LessWronglesswrong.com
- AI #24: Week of the Podcast — LessWronglesswrong.com
- AI #77: A Few Upgrades - by Zvi Mowshowitzthezvi.substack.com
- Your AIs don't do what you want. This is really badrewardhacking.org
- There Is No A.I. | The New Yorkernewyorker.com
- Sporadicamichaelnotebook.com
- Reward hacking is becoming more sophisticated and deliberate in frontier LLMs — LessWronglesswrong.com
- On NYT Magazine on AI: Resist the Urge to be Impressed | by Emily M. Bender | Mediummedium.com