flâneur

Error Bars as Degrees of Belief

brucewlee.com · 1,075 words · saved by 1 readers

The goal in this writing is to understand how error bars can represent degrees of belief rather than just measurement uncertainty. Bayesian statistics represents a broader philosophy about reasoning under uncertainty, modeling how rational agents should update their beliefs when encountering new evidence. We start with prior beliefs, observe data, and arrive at posterior beliefs through a principled updating process. This framework makes assumptions explicit in a way that standard error bars often do not. Specifically, we seek to understand this concept by interpreting this figure from the Anti-Scheming Training paper: The bottom panels show error bars around each measurement. These bars represent something different from what we typically encounter. Standard error bars often implicitly assume normally distributed sampling errors, with formulas that rely on asymptotic approximations. These assumptions can break down with small samples or extreme probabilities, and they remain hidden un

The goal in this writing is to understand how error bars can represent degrees of belief rather than just measurement uncertainty. Bayesian statistics represents a broader philosophy about reasoning under uncertainty, modeling how rational agents should update their beliefs when encountering new evidence. We start with prior beliefs, observe data, and arrive at posterior beliefs through a principled updating process. This framework makes assumptions explicit in a way that standard error bars often do not. Specifically, we seek to understand this concept by interpreting this figure from the Ant

related reading