flâneur

One-tailed vs Two-tailed Tests of Significance in A/B Testing | Analytics-Toolkit.com

blog.analytics-toolkit.com · 4,630 words · saved by 1 readers

We use "cookies" to assist your surfing experience and to target advertising based on your interest in our tools. By using this site you're agreeing with our privacy policy.I Agree Statistics calculators Last updated: August 8, 2018 Georgi Georgiev The question of whether one should run A/B tests (a.k.a online controlled experiments) using one-tailed versus two-tailed tests of significance was something I didn’t even consider important, as I thought the answer (one-tailed) was so self-evident that no discussion was necessary. However, while preparing for my course on “Statistics in A/B Testing” for the ConversionXL Institute, an article has come to my attention, which collected advice from prominent figures in the CRO industry who mostly recommended two-sided tests over one-sided tests for reasons so detached from reality and so contrary to all logic, that I was forced to recognize the issue as being much bigger than suspected. The fact that almost all known industry vendors are report

One-tailed vs Two-tailed Tests of Significance in A/B Testing | Analytics-Toolkit.com One-tailed vs Two-tailed Tests of Significance in A/B Testing Last updated: August 8, 2018 Georgi Georgiev The question of whether one should run A/B tests (a.k.a online controlled experiments) using one-tailed versus two-tailed tests of significance was something I didn’t even consider important, as I thought the answer (one-tailed) was so self-evident that no discussion was necessary. However, while preparing for my course on “ Statistics in A/B Testing ” for the ConversionXL Institute, an

related reading