✳flâneur — a map of the web's best reading

Experiment statistics overview - Docs - PostHog

posthog.com · 2,017 words · saved by 1 readers

A working understanding of statistical methodology is helpful to feel confident about interpreting experiment results. For those without prior…

Bayesian statistics Contents Input data: What goes into the analysis Funnel metrics Mean metrics Ratio metrics What the experimentation pipeline does Step 1: Data aggregation Aggregation into sufficient statistics Outlier handling (winsorization) Step 2: Data quality validation Step 3: Calculate effect size and variance Effect size calculation Variance calculation Step 4: Bayesian posterior update The prior distribution The posterior distribution Step 5: Generate results Chance to win Credible interval Significance (decisiveness) Configuring the confidence level Mathematical formulas reference

Explore this link on the map →

related reading