Skip to content

stbenjam/benchmarks

v0.1.0

Skills for benchmark and eval tasks, such as guided walkthroughs of a task, its verifier, and its review rubric.

benchmarks

Skills for benchmark and eval tasks, such as guided walkthroughs of a task, its verifier, and its review rubric.

See the main installation guide for Claude Code, Codex, and standalone Agent Skills setup.

Skills

  • task-walkthrough — Walk through a Terminal-Bench task, internal eval, or benchmark task PR for a competent CS engineer, explain its verifier and review rubric, then check understanding with one applied question at a time. Use when the user wants to understand or present a task before reviewing it.

Task walkthroughs

Use task-walkthrough with a task directory or task PR. It explains the domain, model difficulty, realism, task flow, verifier and isolation, and rubric compliance, then points to the key code sections. After the summary, it asks 3–5 applied questions one at a time to check your understanding.

Use $task-walkthrough to walk me through this eval task PR.