A/B & Gradual Rollout — The Same, But Different | by Nir Boger | Medium
People ask me: “Nir, what is the difference between A/B testing and Gradual rollout?” This post will try to give an answer to this question When we refer to Gradual Rollout we are talking about a methodology of deploying a new feature to the users by degrees, rather than deploy it suddenly to all of the users There is 1 reason for gradually rolling out new feature and the reason is to: reduce the risk when deploying a brand new feature So you have the most talented QA team. The QA team found all the bugs on your feature, but does the QA knows if it works for the user? Let’s explain it using an example: Now you have 2 options: Let’s imagine that your users start complaining to your support that after 3 days the device turned off with no reason consistently. Your engineering team investigate this issue and find out it happens only to users that have linked their exchange account to their device, and it is happening only after only 3 days… The engineering team then fix this bug and a new
Press enter or click to view image in full size Ab Culture Ab Testing A/B & Gradual Rollout — The Same, But Different Nir Boger 4 min read · Feb 3, 2014 -- Listen Share People ask me: “Nir, what is the difference between A/B testing and Gradual rollout?” This post will try to give an answer to this question Gradual Rollout When we refer to Gradual Rollout we are talking about a methodology of deploying a new feature to the users by degrees, rather than deploy it suddenly to all of the users Why? There is 1 reason for gradually rolling out new feature and the reason is to: reduce the risk when
related reading
- 5 Mistakes To Avoid When Running A/B Tests - Issue 87dataanalysis.substack.com
- A/B testing mistakes I learned the hard way - PostHogposthog.com
- The A/B Test: Inside the Technology That's Changing the Rules of Business | WIREDwired.com
- Canary Releasemartinfowler.com
- Google Mobile UX Marathon 雙週心得(三)medium.com
- Detecting interference: An A/B test of A/B testslinkedin.com
- Demystifying evals for AI agents \ Anthropicanthropic.com
- The Perils and Benefits of AB Testingcaseyaccidental.com
- What Are Deployment Patterns?newsletter.techworld-with-milan.com
- The top 3 mistakes that make your A/B test results invalidconversion.com
- P-Hacking in Startups | Hacker Newsnews.ycombinator.com
- Knowing when to launch: what is the balance between research vs release-and-learn? | by Melanie Hambarsoomian | Mediummelhambo.medium.com