Error Bars as Degrees of Belief
The goal in this writing is to understand how error bars can represent degrees of belief rather than just measurement uncertainty. Bayesian statistics represents a broader philosophy about reasoning under uncertainty, modeling how rational agents should update their beliefs when encountering new evidence. We start with prior beliefs, observe data, and arrive at posterior beliefs through a principled updating process. This framework makes assumptions explicit in a way that standard error bars often do not. Specifically, we seek to understand this concept by interpreting this figure from the Anti-Scheming Training paper: The bottom panels show error bars around each measurement. These bars represent something different from what we typically encounter. Standard error bars often implicitly assume normally distributed sampling errors, with formulas that rely on asymptotic approximations. These assumptions can break down with small samples or extreme probabilities, and they remain hidden un
The goal in this writing is to understand how error bars can represent degrees of belief rather than just measurement uncertainty. Bayesian statistics represents a broader philosophy about reasoning under uncertainty, modeling how rational agents should update their beliefs when encountering new evidence. We start with prior beliefs, observe data, and arrive at posterior beliefs through a principled updating process. This framework makes assumptions explicit in a way that standard error bars often do not. Specifically, we seek to understand this concept by interpreting this figure from the Ant
Explore this link on the map →related reading
- bayesian - What's the difference between a confidence interval and a credible interval? - Cross Validatedstats.stackexchange.com
- Bayesian Mindsetcold-takes.com
- Confidence all the way upmindingourway.com
- blog.alexalemi.com A Degree of Certaintyblog.alexalemi.com
- The Bayes Banditfrancesco215.github.io
- Bayes' rule — LessWrongarbital.com
- Against NHST — LessWronglesswrong.com
- Writing - betanalpha.github.iobetanalpha.github.io
- Words of estimative probability - Wikipediaen.wikipedia.org
- Probabilities Without Measurements | Vaden Masranivmasrani.github.io
- Why we can't take expected value estimates literally (even when they're unbiased) - The GiveWell Blogblog.givewell.org
- A Technical Explanation of Technical Explanation – Eliezer S. Yudkowskyyudkowsky.net