Skip to content

using-system/vllm-on-tap

v0.2.3MIT

Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.

What this package declares

The file a client reads when it loads this plugin, exactly as this revision carries it.

plugin.json
{
  "$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
  "name": "vllm-on-tap",
  "version": "0.2.3",
  "description": "Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.",
  "author": {
    "name": "using-system",
    "url": "https://github.com/using-system"
  },
  "homepage": "https://github.com/using-system/vllm-on-tap#readme",
  "repository": "https://github.com/using-system/vllm-on-tap",
  "license": "MIT",
  "keywords": [
    "vllm",
    "inference",
    "llm",
    "azure",
    "azure-container-apps",
    "gpu",
    "opentelemetry"
  ]
}

What else this package ships

These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.

  • LICENSE
View on GitHub