Promote or Roll Back the Winner
Ship the better model or revert cleanly.
The Test Is Over
Your A/B test has run its full window and the numbers are in. Now comes the decision: promote the challenger or roll it back to the champion. 🚦
Decide Against Your Plan
Pull up the success criteria you wrote before the test. The challenger wins only if it beats the threshold on the primary metric and breaks no guardrail.
All lessons in this course
- Split Traffic Between Model Versions
- Pick Metrics That Matter
- Read Significance Without Fooling Yourself
- Promote or Roll Back the Winner