ghchinoy/mizan-eval

v0.1.0Apache-2.0

Run Mizan evaluations from an agent: score a single response or compare two responses against a metric template via the mizan CLI, reasoning over the -o json result. Use when you need to evaluate an asset/response against guidance and explain the verdict.

GitHub Open Website

skills

run-eval

Run a single (pointwise) or pairwise Mizan evaluation of a response/asset against a metric template and explain the verdict, driving the mizan CLI over -o json and reasoning over the parsed result. Use when a user asks to evaluate, score, grade, or A/B-compare a text response or media asset against a metric, rubric, or guidance, or to understand why an asset passed/failed an eval.

Version: 0.1.0
License: Apache-2.0
Compatibility: Requires the `mizan` CLI on PATH (go install github.com/ghchinoy/mizan/cmd/mizan@latest). Live evals call Vertex AI and need Google Application Default Credentials (ADC) plus a configured project/location; this skill never takes or stores credentials — it relies on the user's existing ADC exactly as the CLI does.

Read SKILL.md at the source

Pinned to revision 4618d919fcec, so it is the text this page describes rather than whatever the author pushed since.

Files

skills/run-eval/SKILL.md

Every link opens the file at its source, pinned to the revision this page describes.