orq-recommend-evaluators

Use when an orq agent or deployment has no or few evaluators and someone asks which ones it should have ("what should I evaluate", "which evals does this agent need", "suggest evaluators"), including a new agent with no production traffic yet. Do NOT use to build and validate one specific judge in depth (use orq-build-evaluator), to realign a judge that already exists (use orq-evaluator-alignment), or to build a failure taxonomy (use orq-analyze-traces).

Read SKILL.md at the source

Pinned to revision 470ea4cf6fa2, so it is the text this page describes rather than whatever the author pushed since.

Pre-approved tools experimental

Experimental field. Support varies between clients, so this list is what the author declared, not what your client will enforce.

Read
Write
Edit
Grep
Glob
Task
AskUserQuestion
Bash(orq traces list-fields:*)
Bash(orq traces list-facets:*)
Bash(orq traces aggregate:*)
Bash(orq traces search:*)
Bash(orq traces get-span:*)
Bash(orq traces list-spans:*)
Bash(orq traces thread:*)
Bash(orq agents retrieve:*)
Bash(orq agents get-response:*)
Bash(orq agents list:*)
Bash(orq deployments get-config:*)
Bash(orq tools retrieve:*)
Bash(orq knowledge-bases retrieve:*)
Bash(orq memory-stores retrieve:*)
Bash(orq evals get:*)
Bash(orq evals all:*)
Bash(orq evals invoke:*)
Bash(orq models list:*)
Bash(orq evals create:*)
Bash(orq evals update:*)
Bash(orq agents update:*)
Bash(npx -y ajv-cli@5:*)
mcp__orq-workspace__search_entities
mcp__orq-workspace__get_agent
mcp__orq-workspace__get_deployment
mcp__orq-workspace__get_span
mcp__orq-workspace__get_llm_eval
mcp__orq-workspace__get_python_eval
mcp__orq-workspace__search_docs

Files

Every link opens the file at its source, pinned to the revision this page describes.