sikaru-evals
Create and version Sikaru RL environment datasets from CSV or JSONL, run an agent against them, and read pass rates and failed examples. Use when the user wants to evaluate, test, benchmark or regression-check a Sikaru agent, build an eval set or golden dataset, compare agent versions, or find out why examples fail.
Pinned to revision ae2cc284c2a3, so it is the text this page describes rather than whatever the author pushed since.
Files
Every link opens the file at its source, pinned to the revision this page describes.