app-redteam
Adaptive multi-turn red team of an LLM app via promptfoo's crescendo attack engine: genuine multi-turn attacks that read the target's real responses and escalate on refusals, seeded by customized application objectives (with an optional cross-domain cyber pack). Runs fully locally via generate-once → redteam eval. Use to actively find vulnerabilities or stress-test multi-turn robustness. For a fast reproducible benchmark use app-benchmark; for a guardrail in isolation use control-isolate.
- License
- MIT
- Compatibility
- Requires node>=18 and python>=3.11 (for the summary).
Pinned to revision 3fb15e11d58f, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/app-redteam/SKILL.md
- skills/app-redteam/env.example
- skills/app-redteam/install_dependencies.sh
- skills/app-redteam/lib/extract_transcript.js
- skills/app-redteam/lib/redteam_summary.py
- skills/app-redteam/lib/status_policy.js
- skills/app-redteam/lib/transform_response.js
- skills/app-redteam/new_experiment.sh
- skills/app-redteam/objectives/redteam_objectives.cyber.json
- skills/app-redteam/objectives/redteam_objectives.cyber.manifest.json
- skills/app-redteam/objectives/redteam_objectives.json
- skills/app-redteam/objectives/redteam_objectives.manifest.json
- skills/app-redteam/objectives/redteam_objectives.smoke.json
- skills/app-redteam/promptfooconfig.browser.yaml
- skills/app-redteam/promptfooconfig.yaml
- skills/app-redteam/tests/mock_server.py
- skills/app-redteam/tests/test_app_redteam.py
Every link opens the file at its source, pinned to the revision this page describes.