email-evals
Author and safely run deterministic email-agent evaluation suites with dedicated e2a test agents. Use when a user wants to define synthetic email cases, validate a suite, inspect its dry-run plan, run it after approval, or regrade changed assertions.
Pinned to revision 18c6c0edd41b, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/email-evals/SKILL.md
- skills/email-evals/email-evals.sh
- skills/email-evals/launcher.mjs
- skills/email-evals/runtime/THIRD_PARTY_NOTICES.md
- skills/email-evals/runtime/cli.mjs
- skills/email-evals/runtime/email-evals-runtime.bundle.mjs
- skills/email-evals/runtime/lib/cli-arguments.mjs
- skills/email-evals/runtime/lib/contract.mjs
- skills/email-evals/runtime/lib/e2a-adapter.mjs
- skills/email-evals/runtime/lib/errors.mjs
- skills/email-evals/runtime/lib/grade-content.mjs
- skills/email-evals/runtime/lib/grade-core.mjs
- skills/email-evals/runtime/lib/mime.mjs
- skills/email-evals/runtime/lib/normalize.mjs
- skills/email-evals/runtime/lib/report.mjs
- skills/email-evals/runtime/lib/result-contract.mjs
- skills/email-evals/runtime/lib/runner.mjs
- skills/email-evals/runtime/lib/safe-pattern.mjs
- skills/email-evals/runtime/package-lock.json
- skills/email-evals/runtime/package.json
- skills/email-evals/runtime/test/bundle.test.mjs
- skills/email-evals/runtime/test/cli.test.mjs
- skills/email-evals/runtime/test/contract.test.mjs
- skills/email-evals/runtime/test/e2a-adapter-observe.test.mjs
- skills/email-evals/runtime/test/e2a-adapter-preflight.test.mjs
- skills/email-evals/runtime/test/final-security.test.mjs
- skills/email-evals/runtime/test/grade-content.test.mjs
- skills/email-evals/runtime/test/grade-core.test.mjs
- skills/email-evals/runtime/test/launcher.test.mjs
- skills/email-evals/runtime/test/live-responder.mjs
- skills/email-evals/runtime/test/mime.test.mjs
- skills/email-evals/runtime/test/report.test.mjs
- skills/email-evals/runtime/test/runner.test.mjs
- skills/email-evals/runtime/test/safe-pattern.test.mjs
- skills/email-evals/runtime/test/scaffold.test.mjs
- skills/email-evals/runtime/test/setup.test.mjs
- skills/email-evals/runtime/testdata/contracts/invalid/bad-duration/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/bad-regex/case.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/bad-regex/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/case-traversal/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/duplicate-key/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/escape.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/missing-envelope-expectation/case.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/missing-envelope-expectation/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/missing-environment/case.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/missing-environment/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/partial-environment/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/recipient-outside-allowlist/case.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/recipient-outside-allowlist/suite.yaml
- skills/email-evals/runtime/testdata/contracts/invalid/unknown-key/suite.yaml
- skills/email-evals/runtime/testdata/contracts/valid/cases/happy-path.yaml
- skills/email-evals/runtime/testdata/contracts/valid/cases/missing-information.yaml
- skills/email-evals/runtime/testdata/contracts/valid/cases/unsafe-request.yaml
- skills/email-evals/runtime/testdata/contracts/valid/suite.yaml
- skills/email-evals/runtime/testdata/e2a/events-blocked.json
- skills/email-evals/runtime/testdata/e2a/events-success.json
- skills/email-evals/runtime/testdata/e2a/protection-safe.json
- skills/email-evals/runtime/testdata/e2a/protection-wide.json
- skills/email-evals/runtime/testdata/evidence/core-forward.json
- skills/email-evals/runtime/testdata/evidence/core-safe-reply.json
- skills/email-evals/runtime/testdata/mime/attachment.eml
- skills/email-evals/runtime/testdata/mime/header-injection.eml
- skills/email-evals/runtime/testdata/mime/reply.eml
- skills/email-evals/runtime/testdata/reports/mixed/cases.jsonl
- skills/email-evals/runtime/testdata/reports/mixed/report.md
- skills/email-evals/runtime/testdata/reports/mixed/summary.json
- skills/email-evals/runtime/testdata/reports/pass/cases.jsonl
- skills/email-evals/runtime/testdata/reports/pass/report.md
- skills/email-evals/runtime/testdata/reports/pass/summary.json
- skills/email-evals/scaffold.mjs
- skills/email-evals/setup.mjs
- skills/email-evals/templates/README.md
- skills/email-evals/templates/cases/happy-path.yaml
- skills/email-evals/templates/cases/missing-information.yaml
- skills/email-evals/templates/cases/unsafe-request.yaml
- skills/email-evals/templates/fixtures/README.md
- skills/email-evals/templates/results/.gitignore
- skills/email-evals/templates/suite.yaml
Every link opens the file at its source, pinned to the revision this page describes.