orq-ai/orq
v3.9.0MIT
Agent skills for building, deploying, evaluating, and monitoring LLM pipelines on the orq.ai platform.
MCP servers declared in a file that clients do not read
This package ships a
.mcp.json. Agent Plugins reads MCP configuration from mcp.json, so a client installing this plugin finds no servers. The directory does not read the file either, and shows nothing from it.allowed-tools
- Glob18 skills
- Grep18 skills
- Read18 skills
- Edit17 skills
- Write17 skills
- AskUserQuestion16 skills
- mcp__orq-workspace__search_entities14 skills
- Task13 skills
60 more
- WebFetch11 skills
- mcp__orq-workspace__search_docs7 skills
- Bash(curl:*)6 skills
- mcp__orq-workspace__get_agent6 skills
- mcp__orq-workspace__get_deployment4 skills
- Bash(orq agents get-response:*)3 skills
- Bash(orq agents retrieve:*)3 skills
- Bash(orq deployments get-config:*)3 skills
- Bash(orq evals get:*)3 skills
- Bash(orq knowledge-bases retrieve:*)3 skills
- Bash(orq memory-stores retrieve:*)3 skills
- Bash(orq tools retrieve:*)3 skills
- Bash(orq traces aggregate:*)3 skills
- Bash(orq traces conv:*)3 skills
- Bash(orq traces conversation:*)3 skills
- Bash(orq traces get-span:*)3 skills
- Bash(orq traces list-facets:*)3 skills
- Bash(orq traces list-fields:*)3 skills
- Bash(orq traces list-spans:*)3 skills
- Bash(orq traces search:*)3 skills
- mcp__orq-workspace__get_llm_eval3 skills
- mcp__orq-workspace__get_python_eval3 skills
- mcp__orq-workspace__get_span3 skills
- mcp__orq-workspace__list_models3 skills
- mcp__orq-workspace__list_traces3 skills
- Bash(eq:*)2 skills
- Bash(jq:*)2 skills
- Bash(orq agents update:*)2 skills
- Bash(orq reporting query:*)2 skills
- Bash(orq skills get:*)2 skills
- Bash(orq traces list-facet-values:*)2 skills
- mcp__orq-workspace__create_datapoints2 skills
- mcp__orq-workspace__create_dataset2 skills
- mcp__orq-workspace__list_datapoints2 skills
- Bash1 skill
- Bash(npm:*)1 skill
- Bash(npx -y ajv-cli@5:*)1 skill
- Bash(npx:*)1 skill
- Bash(orq agents list:*)1 skill
- Bash(orq evals all:*)1 skill
- Bash(orq evals create:*)1 skill
- Bash(orq evals invoke:*)1 skill
- Bash(orq evals update:*)1 skill
- Bash(orq models list:*)1 skill
- Bash(orq:*)1 skill
- Bash(pip:*)1 skill
- Bash(python:*)1 skill
- Bash(uv run:*)1 skill
- Bash(uv:*)1 skill
- mcp__orq-workspace__create_llm_eval1 skill
- mcp__orq-workspace__get_analytics_overview1 skill
- mcp__orq-workspace__get_experiment_run1 skill
- mcp__orq-workspace__get_skill1 skill
- mcp__orq-workspace__list_experiment_runs1 skill
- mcp__orq-workspace__list_skills1 skill
- mcp__orq-workspace__list_spans1 skill
- mcp__orq-workspace__query_analytics1 skill
- mcp__orq-workspace__update_datapoint1 skill
- ToolSearch1 skill
- WebSearch1 skill
scripts
- evaluatorq
- tests/test_documented_api.py
- orq-compare-agents
- tests/ts/contract.ts
- orq-evaluator-alignment
- lib/__init__.py
- lib/agreement.py
- lib/content.py
- lib/cost.py
- lib/cross_model.py
52 more
- lib/grey_zone.py
- lib/instability.py
- lib/judge.py
- lib/model_backend.py
- lib/orq_client.py
- lib/panel.py
- lib/runner.py
- lib/seed.py
- scripts/_bootstrap.py
- scripts/aggregate.py
- scripts/build_queue.py
- scripts/create_eval.py
- scripts/cross_model.py
- scripts/dataset_inputs.py
- scripts/estimate_cost.py
- scripts/fetch_evaluator.py
- scripts/fetch_traces.py
- scripts/grey_zone.py
- scripts/metrics.py
- scripts/recommend.py
- scripts/retest.py
- scripts/rewrite_eval.py
- scripts/seed_inputs.py
- scripts/serve_annotation.py
- scripts/stability.py
- tests/test_agreement.py
- tests/test_aligned_naming.py
- tests/test_backend_selection.py
- tests/test_build_queue.py
- tests/test_build_queue_projection.py
- tests/test_build_queue_seed.py
- tests/test_correctness.py
- tests/test_create_eval.py
- tests/test_cross_model.py
- tests/test_dataset_client.py
- tests/test_fetch_traces.py
- tests/test_fetch_types.py
- tests/test_grey_zone.py
- tests/test_grey_zone_cli.py
- tests/test_instability.py
- tests/test_judge_typed.py
- tests/test_panel.py
- tests/test_parse_verdict.py
- tests/test_pipeline.py
- tests/test_recommend.py
- tests/test_retest.py
- tests/test_rewrite.py
- tests/test_script_deps.py
- tests/test_seed.py
- tests/test_serve_annotation.py
- tests/test_tls_verify.py
- tests/test_traces_fingerprint.py
plugin.json
- name
- orq
- version
- 3.9.0
- description
- Agent skills for building, deploying, evaluating, and monitoring LLM pipelines on the orq.ai platform.
- author
- orq.aihttps://orq.ai
- license
- MIT
- homepage
- https://orq.ai
{
"$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
"name": "orq",
"version": "3.9.0",
"description": "Agent skills for building, deploying, evaluating, and monitoring LLM pipelines on the orq.ai platform.",
"author": {
"name": "orq.ai",
"url": "https://orq.ai"
},
"homepage": "https://orq.ai",
"repository": "https://github.com/orq-ai/assistant-plugins",
"license": "MIT",
"keywords": ["orq", "llm", "agents", "prompts", "deployments", "evaluation", "monitoring", "rag", "experiments", "traces"]
}
What else this package ships
These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.
- 58Python files
- contract.ts
- 32JSON files
- 2configuration files
- 2text files
- 4other files