Statisticism: How Cluster-Thinking About Data Creates Blind Spots
There is an epistemic stance, common among academics in quantitative fields, academics who wish they were in quantitative fields, and independent scholars who do not wish to decorrelate too much from the academic mainstream by communicating in an incompatible dialect, that treats statistical convergence as the gold standard of evidence. If many indicators point the same direction, the signal is real. Call this statisticism. It converges on truth when your instruments have independent errors. It diverges from truth when they share a systematic distortion, because then convergence is what the distortion looks like. The following example illustrates a case where it fails, and why. The US homicide rate doubled between 1960 and 1980, then fell by more than half between 1991 and 2014. I argued that the fall is mostly a medical artifact: trauma surgery vastly improved, so the same rate of shootings produced fewer deaths. I constructed an adjusted trend line using two independent data sources
There is an epistemic stance, common among academics in quantitative fields, academics who wish they were in quantitative fields, and independent scholars who do not wish to decorrelate too much from the academic mainstream by communicating in an incompatible dialect, that treats statistical convergence as the gold standard of evidence. If many indicators point in the same direction, the signal is real. Call this statisticism. It converges on truth when your instruments have independent errors. It diverges from truth when they share a systematic distortion, because then convergence is what the
related reading
- Berkson's paradox - Wikipediaen.wikipedia.org
- Getting Eulered | Slate Star Codexslatestarcodex.com
- There are no statistics in the Kingdom of Godexperimental-history.com
- Beware The Man Of One Studyslatestarcodex.com
- The Limits of Dataissues.org
- How Should We Critique Research? · Gwern.netgwern.net
- How Should We Critique Research? · Gwern.netgwern.net
- Your intuitions are not magic — LessWronglesswrong.com
- Local Validity as a Key to Sanity and Civilization — LessWronglesswrong.com
- In defence of epistemic modesty — EA Forumforum.effectivealtruism.org
- Intuitive statistics - Wikipediaen.wikipedia.org
- It’s the end of science as we know it, and I feel finestatnews.com