Skip to content

alchemyincode/plumloom-autoeval

v0.1.0Apache-2.0

Run Plumloom Autoeval evaluations and release gates from a coding agent. Checks setup and validates evaluation files without spending a run, runs an eval or a suite gate, and reports the verdict Autoeval returns.

GitHubOpen Website
autoeval

Run Plumloom Autoeval evaluations and release gates for AI agents and LLM features from the terminal. Use when the user asks to evaluate or test an agent, prompt, model or RAG change, run evals or an eval suite, check whether a change is safe to release, gate a release, or read evaluation results, scores or a PASS / FAIL / INCONCLUSIVE verdict. Reports the verdict Autoeval returns and never edits evals or thresholds to change it.