blinded-eval
Blinded evaluation of a Skill, rule, or prompt change. The parent designs the experiment, isolates candidates in throwaway directories, runs the same organic user prompt, and scores artifacts against a held-back rubric. Apply when the user invokes /blinded-eval, asks to eval or A/B a skill change, or authoring Phase 4 says the change would alter agent behavior. Use authoring-skills-and-rules to write the skill; use dissect to audit an existing system.
Pinned to revision 7c3a5e04075f, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/blinded-eval/SKILL.md
- skills/blinded-eval/references/blinding.md
- skills/blinded-eval/references/judge-prompt.md
Every link opens the file at its source, pinned to the revision this page describes.