phoenix-evals
Build, run, and validate evaluators for AI/LLM applications with Phoenix, in Python or TypeScript (including Vercel AI SDK apps) — code-based checks and LLM-as-a-judge, run over exported traces or dataframes or as Phoenix experiments, gate them in CI, and validate judges against human-labeled data.
- Version
- 1.0.0
- License
- Apache-2.0
- Compatibility
- Requires Phoenix server. Python skills need phoenix and openai packages; TypeScript skills need @arizeai/phoenix-client.
Pinned to revision a1e39e0e83c2, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/phoenix-evals/SKILL.md
- skills/phoenix-evals/references/axial-coding.md
- skills/phoenix-evals/references/common-mistakes-python.md
- skills/phoenix-evals/references/error-analysis-multi-turn.md
- skills/phoenix-evals/references/error-analysis.md
- skills/phoenix-evals/references/evaluate-dataframe-python.md
- skills/phoenix-evals/references/evaluators-code-python.md
- skills/phoenix-evals/references/evaluators-code-typescript.md
- skills/phoenix-evals/references/evaluators-custom-templates.md
- skills/phoenix-evals/references/evaluators-llm-python.md
- skills/phoenix-evals/references/evaluators-llm-typescript.md
- skills/phoenix-evals/references/evaluators-overview.md
- skills/phoenix-evals/references/evaluators-pre-built.md
- skills/phoenix-evals/references/evaluators-rag.md
- skills/phoenix-evals/references/experiments-datasets-python.md
- skills/phoenix-evals/references/experiments-datasets-typescript.md
- skills/phoenix-evals/references/experiments-overview.md
- skills/phoenix-evals/references/experiments-running-python.md
- skills/phoenix-evals/references/experiments-running-typescript.md
- skills/phoenix-evals/references/experiments-synthetic-python.md
- skills/phoenix-evals/references/experiments-synthetic-typescript.md
- skills/phoenix-evals/references/filter-expressions.md
- skills/phoenix-evals/references/fundamentals-anti-patterns.md
- skills/phoenix-evals/references/fundamentals-model-selection.md
- skills/phoenix-evals/references/fundamentals.md
- skills/phoenix-evals/references/integrations-pytest.md
- skills/phoenix-evals/references/integrations-vitest-jest.md
- skills/phoenix-evals/references/observe-sampling-python.md
- skills/phoenix-evals/references/observe-sampling-typescript.md
- skills/phoenix-evals/references/observe-tracing-setup.md
- skills/phoenix-evals/references/production-continuous.md
- skills/phoenix-evals/references/production-guardrails.md
- skills/phoenix-evals/references/production-overview.md
- skills/phoenix-evals/references/setup-python.md
- skills/phoenix-evals/references/setup-typescript.md
- skills/phoenix-evals/references/validation-evaluators-python.md
- skills/phoenix-evals/references/validation-evaluators-typescript.md
- skills/phoenix-evals/references/validation.md
Every link opens the file at its source, pinned to the revision this page describes.