pr-review-tuning
The weekly self-tuning loop for the MCode Review bot on GitHub or GitLab. Measures the bot on a repository's recent PRs (threads per PR, which kinds people answer or dismiss, what was unanswered at merge, cost per round, time to merge, follow-up fixes), finds noise and misses, proposes at most three rule changes with their expected effect on each goal, backtests them on past PRs with known outcomes within an agreed token budget, has an independent check recompute the numbers, and changes rules only after a person approves. The first run only measures. Use for requests to run pr-review-tuning or to measure or tune the review bot, for the weekly scheduled run, and for settling a proposal (approve or reject P1).
Pinned to revision 0db1b4fb3b62, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/pr-review-tuning/SKILL.md
- skills/pr-review-tuning/.gitignore
- skills/pr-review-tuning/references/backtest.md
- skills/pr-review-tuning/references/metrics.md
- skills/pr-review-tuning/references/proposals.md
- skills/pr-review-tuning/references/report-template.md
- skills/pr-review-tuning/references/scheduling.md
- skills/pr-review-tuning/scripts/backtest.mjs
- skills/pr-review-tuning/scripts/collect.mjs
- skills/pr-review-tuning/scripts/lib/common.mjs
- skills/pr-review-tuning/scripts/lib/guard.mjs
- skills/pr-review-tuning/scripts/metrics.mjs
- skills/pr-review-tuning/scripts/test/backtest.test.mjs
- skills/pr-review-tuning/scripts/test/collect.test.mjs
- skills/pr-review-tuning/scripts/test/fixtures/backtest/fake-review.mjs
- skills/pr-review-tuning/scripts/test/fixtures/metrics/previous-metrics.json
- skills/pr-review-tuning/scripts/test/fixtures/metrics/prs.jsonl
- skills/pr-review-tuning/scripts/test/metrics.test.mjs
Every link opens the file at its source, pinned to the revision this page describes.