Legacy statistics methodology - Docs - PostHog

Note: This document describes methodology used to evaluate experiments created prior to January 2025. Check out our statistics overview for an…

Legacy statistics methodology Contents Bayesian experimentation Funnel experiment calculations 1. Probability of being the best 2. Statistical significance Trend experiment calculations 1. Probability of being the best 2. Statistical significance How does PostHog determine final significance? Note: This document describes methodology used to evaluate experiments created prior to January 2025. Check out our statistics overview for an introduction to our updated methodology. Bayesian experimentation In the field of experimentation, there are two primary statistical approaches: frequentist and Ba

related reading

• Bayesian statistics - Docs - PostHogposthog.com
• PostHog – We make your product self-drivingposthog.com
• How much do you believe your results? — LessWronglesswrong.com
• Against NHST — LessWronglesswrong.com
• bayesian - Bayes regression: how is it done in comparison to standard regression? - Cross Validatedstats.stackexchange.com
• Is power analysis necessary in Bayesian Statistics? - Cross Validatedstats.stackexchange.com
• Bayesian programming - Wikipediaen.wikipedia.org
• Statistics: Are you Bayesian or Frequentist? | Towards Data Sciencetowardsdatascience.com
• Multiple Hypothesis Testing | Stitch Fix Technology – Multithreadedmultithreaded.stitchfix.com
• A/B testing mistakes I learned the hard way - PostHogposthog.com
• Running time and sample size - Docs - PostHogposthog.com
• What’s All the Buzz About Bayes? – Psychology in Actionpsychologyinaction.org