duo-experimentation
Duolingo-style experimentation as a decision protocol — hundreds of A/B tests a week, opinions resolved by data, ideas killed quickly. Covers hypothesis design, metric selection, guardrails, sample size, novelty effects, and explicit kill criteria. Use when the user wants to run an A/B test, decide between two designs without arguing, set up an experiment program, debug why a test isn't moving, or build a culture where "show don't tell" replaces seniority-based decisions. Source the Duolingo Handbook (Show Don't Tell) and engineering blog posts.
- Version
- 1.0.0
- License
- MIT
Pinned to revision 78072c9528fb, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/duo-experimentation/SKILL.md
- skills/duo-experimentation/references/ab-test-structure.md
- skills/duo-experimentation/references/baseline-at-first-contact.md
- skills/duo-experimentation/references/design-the-population.md
- skills/duo-experimentation/references/experiment-cadence.md
- skills/duo-experimentation/references/guardrail-metrics.md
- skills/duo-experimentation/references/hypothesis-design.md
- skills/duo-experimentation/references/invariant-metric-for-redesigns.md
- skills/duo-experimentation/references/kill-criteria.md
- skills/duo-experimentation/references/ladder-of-evidence.md
- skills/duo-experimentation/references/metric-selection.md
- skills/duo-experimentation/references/novelty-effects.md
- skills/duo-experimentation/references/outcome-not-engagement.md
- skills/duo-experimentation/references/probes-inside-the-product.md
- skills/duo-experimentation/references/quasi-experiments.md
- skills/duo-experimentation/references/sample-size.md
- skills/duo-experimentation/references/ship-and-iterate.md
- skills/duo-experimentation/references/show-dont-tell.md
- skills/duo-experimentation/references/unmeasurable-wins.md
Every link opens the file at its source, pinned to the revision this page describes.