Goodhart’s Law, the Cobra Effect, and Dunning-Kreuger • Posts by EIM | Evidence In Motion
evidenceinmotion.com · 990 words · saved by 1 readers
If the test itself becomes a training tool, then are you simply training to the test and does the test actually still work?
Goodhart’s Law, the Cobra Effect, and Dunning-Kreuger November 19, 2019 • Sports It happened again. I got caught in the black hole of web-surfing and the downward trundling of “ oh, what ‘ s that? That sounds interesting,” which led to a 4-hour adventure into interesting concepts and underlying psychologic phenomena. Enjoy! Let ‘ s start with a thought-provoking idea. Have you ever considered how expectations or targets might influence our motives, decision-making, and/or actions? Well, Goodhart ‘ s Law is exactly that: “ When a measure becomes a target
related reading
- Goodhart's law - Wikipediaen.wikipedia.org
- Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law | Jascha’s blogsohl-dickstein.github.io
- What's going on here, with this human? - Graham Duncan Bloggrahamduncan.blog
- Goodhart's Law and Why Measurement is Hard — Ribbonfarmribbonfarm.com
- Pain is not the unit of Effort — LessWronglesswrong.com
- Home | Laws of UXlawsofux.com
- On Really Trying · Gwern.netgwern.net
- The Lesson to Unlearnpaulgraham.com
- Goal Factoring — LessWronglesswrong.com
- The Lesson to Unlearnpaulgraham.com
- The Lesson to Unlearnpaulgraham.com
- Judgments often smuggle in implicit standards — LessWronglesswrong.com