benchmark-curator
Curate and version eval corpora for Agent Skills: case taxonomies, discovery/forced/negative controls, adversarial and regression cases, difficulty strata, holdout isolation, provenance, duplication, contamination, coverage balance, and benchmark hashes. Do not use to run the experiment or claim lift (skill-evaluator), to design the grading rubric (rubric-designer), to edit the skill (skill-creator), or to call leaked cases a clean holdout. Use to build an eval dataset, golden set, benchmark suite, regression corpus, or holdout.
Pinned to revision ea925139e5f4, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/benchmark-curator/SKILL.md
- skills/benchmark-curator/CHANGELOG.md
- skills/benchmark-curator/LICENSE
- skills/benchmark-curator/MATURITY.json
- skills/benchmark-curator/README.md
- skills/benchmark-curator/VERSION
- skills/benchmark-curator/agents/openai.yaml
- skills/benchmark-curator/assets/icon.svg
- skills/benchmark-curator/evals/cases.json
- skills/benchmark-curator/evals/real-host.json
- skills/benchmark-curator/references/benchmark-model.md
- skills/benchmark-curator/references/contract.json
- skills/benchmark-curator/references/coverage-and-balance.md
- skills/benchmark-curator/references/evaluation.md
- skills/benchmark-curator/references/holdout-and-contamination.md
- skills/benchmark-curator/references/leakage-detection.md
- skills/benchmark-curator/references/output-contract.md
- skills/benchmark-curator/references/untrusted-input.md
- skills/benchmark-curator/scripts/kernel.py
- skills/benchmark-curator/scripts/run_evals.py
- skills/benchmark-curator/tests/front-door-rules.json
Every link opens the file at its source, pinned to the revision this page describes.