solution-testing

How to test a solution alternative before building it — problem evidence vs. solution evidence, the cheapest test that could refute the riskiest belief, the test menu by risk (concierge, Wizard of Oz, prototype shown, usability test, technical test, fake door, buyer conversation), thresholds and decision rules written before the run, provenance of results, and the tests file format. Use when deciding how to test an idea or alternative before a spec, designing a prototype test or concierge test, choosing a signal and threshold for an experiment without a product, analyzing solution test results, or deciding whether an alternative continues, changes, or is discarded.