evaluation

Pick the right AI model with evidence: compare Claude, Gemini, OpenAI, cloud and local models; run your own examples to…

Create, tune and record typed configurable logic graphs with Sapho.

Field notes for building on Gemini Enterprise Agent Platform: ADK vs A2A registration, A2UI rendering, Agent Identity,…

Run Plumloom Autoeval evaluations and release gates from a coding agent. Checks setup and validates evaluation files…

Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore (Strands,…

Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore (Strands,…

Graded agent skills from the Super Agent Skill network: every skill carries a public Trust Score, adversarial pass rate…

Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation,…

Build and replay controlled agent attack scenarios with measurable evidence.

Run the frozen UNISON-StateBench v0.1 empirical workflow through Kaggle's official MCP server without modifying the…

Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation,…

Write, run and audit skill-lens eval suites for Agent Skills: which cases a skill needs, which check fits each claim,…

Build and restore portable agent skills and packages with source-backed ecosystem research, worked examples and…

Run Mizan evaluations from an agent: score a single response or compare two responses against a metric template via the…

Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation,…

Scaffold, develop, evaluate, and deploy AI agents with Google ADK. Bundles skills for the agent development lifecycle.

First-party agent evaluation skill for Codex marketplace plugin.

Assess named artifacts with evidence-cited Hermes Rubric results and explicit coverage limits.

Multi-agent engineering orchestration with planning, parallel execution, evaluation loops, debugging, TDD, and…

AI-native agent skills for running a verifiable software development lifecycle and improving reusable skills through…

AI Agent Development, Evaluation & Deployment Platform

Intent-routed DEFINE, PLAN, BUILD, VERIFY, and lean-context skills with measurable local evaluation.

Read-only candidate verification with explicit discrete-judge and true-logprob modes.

Agent skills for building, deploying, evaluating, and monitoring LLM pipelines on the orq.ai platform.

Experimental evaluation and improvement of agent skills and plugins, including improvement methods.

Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation,…

Admissibility gates for agents that act on physical plants. Check a proposed action against evidence, authority,…

Integrate three.dev into a codebase and work with recorded LLM traffic: route calls through the proxy, define use cases…

Scaffold, develop, evaluate, and deploy LangGraph agents on self-hosted Kubernetes. Bundles skills for the agent…

Scaffold, develop, evaluate, and deploy AI agents with Google ADK. Bundles skills for the agent development lifecycle.

Reviews synthetic change plans against a committed risk policy and writes a bounded recommendation.

Generate, run, and consciously update static (pytest) + LLM (@cursor/sdk) evals when AI primitives change — every…

Trade-Bot engineering workflows for implementation, root-cause debugging, safe OpenAI SDK integration, parallel agent…

Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools,…

Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools,…

Design portable skills and bounded agent systems, with an optional compile-and-proof handoff to a Starlight Foundry…

Expose the Mizan eval engine to agents and MCP clients as callable tools via the `mizan mcp` server. Registers a local…

Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools,…

Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools,…

Creates evidence-grounded incident handoffs without inventing missing facts.

Turn stored Mizan eval results into a self-contained, standalone HTML report from an agent: query results via the mizan…

Provides a deterministic synthetic runbook catalog over MCP.