evals
Use when evaluating the ruby-dev plugin itself — establishing or extending a reproducible baseline, designing eval challenges with planted ground truth, building or running the ruby-dev-evals harness, scoring specialist output, checking rubyist gateway protocol compliance, calibrating an LLM judge, or turning eval findings into prompt fixes. Trigger on 'baseline eval', 'evaluate the plugin', 'eval harness', 'does the plugin beat bare', 'gateway compliance', 'regression test the prompts', 'ruby-dev-evals'.
Pinned to revision 88338d98c444, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/evals/SKILL.md
- skills/evals/references/challenge-design.md
- skills/evals/references/fixture-design.md
- skills/evals/references/gateway-protocol-checks.md
- skills/evals/references/harness-architecture.md
- skills/evals/references/reporting-and-iteration.md
- skills/evals/references/scoring-tiers.md
Every link opens the file at its source, pinned to the revision this page describes.