Skip to content

jaktestowac/ai-quality

v0.1.0MIT

Testing LLM features, guardrails, groundedness and agent skills.

test-llm-guardrails

Maps the trust boundaries of an LLM feature, tests the runtime guardrails around model output (schema, PII, moderation, rendering, tool authorization, resource caps, fail-closed behaviour), and runs an adversarial corpus through every content channel, including retrieval and tool results. Use when an LLM feature reads untrusted content, calls tools, or renders model output, and before such a feature ships. Runs only after written authorization for a named environment. For output-quality regression evals, use the design-llm-eval-suite command.

Read SKILL.md at the source

Pinned to revision c4efc46815a7, so it is the text this page describes rather than whatever the author pushed since.

Files

Every link opens the file at its source, pinned to the revision this page describes.