using-system/vllm-on-tap
v0.2.3MIT
Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.
plugin.json
- name
- vllm-on-tap
- version
- 0.2.3
- description
- Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.
- author
- using-systemhttps://github.com/using-system
- license
- MIT
plugin.json
{
"$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
"name": "vllm-on-tap",
"version": "0.2.3",
"description": "Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.",
"author": {
"name": "using-system",
"url": "https://github.com/using-system"
},
"homepage": "https://github.com/using-system/vllm-on-tap#readme",
"repository": "https://github.com/using-system/vllm-on-tap",
"license": "MIT",
"keywords": [
"vllm",
"inference",
"llm",
"azure",
"azure-container-apps",
"gpu",
"opentelemetry"
]
}
What else this package ships
These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.
- LICENSE