ghchinoy/mizan-mcp

v0.1.0Apache-2.0

Expose the Mizan eval engine to agents and MCP clients as callable tools via the mizan mcp server. Registers a local stdio MCP server (mizan mcp stdio) advertising four tools — mizan_list_metrics, mizan_get_metric (read-only), mizan_eval_run, and mizan_eval_pairwise — plus an agent-in-the-loop eval skill. Use when an agent should discover a judge and run an evaluation over MCP rather than shelling out to the CLI.

GitHub Open Website

MCP servers

Declared in a file that clients do not read

This package ships a .mcp.json. Agent Plugins reads MCP configuration from mcp.json, so a client installing this plugin finds no servers. The directory does not read the file either, and shows nothing from it.

What this package declares

The file a client reads when it loads this plugin, exactly as this revision carries it.

plugin.json

{
  "$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
  "name": "mizan-mcp",
  "version": "0.1.0",
  "description": "Expose the Mizan eval engine to agents and MCP clients as callable tools via the `mizan mcp` server. Registers a local stdio MCP server (`mizan mcp stdio`) advertising four tools — mizan_list_metrics, mizan_get_metric (read-only), mizan_eval_run, and mizan_eval_pairwise — plus an agent-in-the-loop eval skill. Use when an agent should discover a judge and run an evaluation over MCP rather than shelling out to the CLI.",
  "author": {
    "name": "ghchinoy",
    "url": "https://github.com/ghchinoy"
  },
  "homepage": "https://github.com/ghchinoy/mizan/tree/main/plugins/mizan-mcp",
  "repository": "https://github.com/ghchinoy/mizan",
  "license": "Apache-2.0",
  "keywords": [
    "mizan",
    "mcp",
    "model-context-protocol",
    "evaluation",
    "llm-as-judge",
    "pairwise",
    "agent-in-the-loop",
    "vertex-ai",
    "stdio"
  ]
}