Multiple Hypothesis Testing | Stitch Fix Technology – Multithreaded
In recent years, there has been a lot of attention on hypothesis testing and so-called “p-hacking”, or misusing statistical methods to obtain more “significa...
In recent years, there has been a lot of attention on hypothesis testing and so-called “p-hacking” , or misusing statistical methods to obtain more “significant” results. Rightly so: For example, we spend millions of dollars on medical research, and we don’t want to waste our time and money, pursuing false leads caused by flaky statistics. But even if all of our assumptions are met and our data collection is flawless, it’s not always easy to get the statistics right; there are still quite a few subtleties that we need to be aware of. This post introduces some of the interesting phenomena that
saved by
related reading
- P-Hacking in Startups | Hacker Newsnews.ycombinator.com
- Hypothesis Testingtheiilab.com
- Against NHST — LessWronglesswrong.com
- P-Value Method for Hypothesis Testing | Towards Data Sciencetowardsdatascience.com
- Hypothesis testing, type I and type II errorsncbi.nlm.nih.gov
- Searching for outliers | benkuhn.netbenkuhn.net
- Power (statistics) - Wikipediaen.wikipedia.org
- Statistical tests, P values, confidence intervals, and power: a guide to misinterpretationsncbi.nlm.nih.gov
- Nonparametric statistics - Wikipediaen.wikipedia.org
- Software Testing as a Multi-Armed Bandit Problemocram575.substack.com
- The Problem with Using Tests for Statistical Assumptionstheanalysisfactor.com
- Common statistical tests are linear models (or: how to teach stats)lindeloev.github.io