2.3 Experiment Analysis #8
Description
Goal
Analyze simulated A/B tests with real-world complications.
Learn
- Sequential testing and peeking problems
- Segmentation and Simpson's paradox
- Guardrail metrics
- When to stop early
Deliverable
- Analysis notebook with common pitfalls
- Simulated experiment data
Proof Point
THIS FEEDS INTO FasterShops Analytics Platform
Links
→ Feeds into: FasterShops/framework Analytics & A/B Testing
Directory
experimentation/03-experiment-analysis/