Skip to content

zotoio/zoto-eval-system

v0.3.1MIT

Generate, run, and consciously update static (pytest) + LLM (@cursor/sdk) evals when AI primitives change — every proposed change requires user confirmation. YAML+JSONSchema results, surgical update on git diff, sovereign user-authored cases, /canvas-rendered cross-run compare.

zoto-update-evals

Diff-aware eval updater. Detects drift between covered targets and generated eval cases for skills and central plugin eval files (commands/agents/hooks), classifies changes as critical or non-critical, and preserves user-authored cases verbatim. Apply-mode regeneration re-invokes the LLM analyser per drifted primitive and dispatches per-framework static stamping plus the single unified LLM regeneration (regenerateLlm) (CI defaults to cached analyser payloads unless --with-analyser). The _meta.generated === true (case) and // _meta.generated\: true (file) contracts are enforced at runtime AND compile time. Supports targeted mode, rediscovery mode, --no-analyser / CI cache reuse, and CI --check (exit 2 on critical drift).

Read SKILL.md at the source

Pinned to revision d79ebb356136, so it is the text this page describes rather than whatever the author pushed since.

Files

Every link opens the file at its source, pinned to the revision this page describes.