✳flâneur — a map of the web's best reading
p < 0.05 considered harmful - by Richard Demsyn-Jones
simplicityissota.substack.com · 1,596 words · saved by 1 readers
The unreasonable persistence of an old standard
p < 0.05 considered harmful The unreasonable persistence of an old standard Richard Demsyn-Jones Apr 10, 2023 2 Share I spend a lot of time thinking about decision criteria for shipping experimental features. The topic could use a little more attention. Maybe it’s higher up the Maslow’s hierarchy of experimentation, somewhere above the prerequisites of actually running randomized experiments, constructing them optimally, and analyzing them correctly. Yet it is still important to actually ask: under what conditions do we ship? When it comes to this question, there’s a magic number that breaks t
Explore this link on the map →related reading
- What a nerdy debate about p-values shows about science — and how to fix it | Voxvox.com
- Against NHST — LessWronglesswrong.com
- An Actually Correct Explanation of P-Valuesoutsidetheasylum.blog
- Searching for outliers | benkuhn.netbenkuhn.net
- P-Value Method for Hypothesis Testing | Towards Data Sciencetowardsdatascience.com
- Multiple Hypothesis Testing | Stitch Fix Technology – Multithreadedmultithreaded.stitchfix.com
- 看電影學統計:p值的陷阱 (3) – 「摘櫻桃」問題 – 菜市場政治學whogovernstw.org
- E-values - Wikipediaen.wikipedia.org
- Legacy statistics methodology - Docs - PostHogposthog.com
- How Should We Critique Research? · Gwern.netgwern.net
- How Should We Critique Research? · Gwern.netgwern.net
- Bayesian Mindsetcold-takes.com