Skip to content

using-system/vllm-on-tap

v0.2.3MIT

Serve vLLM presets on demand - locally, Kubernetes (KServe), Azure (Container Apps), AWS (ECS) or GCP (Cloud Run) - with their traces over OTLP, and tear them down again.

GitHubOpen Website
skills

vot-instrument-preset

Create or edit a vllm-on-tap custom preset in .vot/presets/ from a free-form request - a model of interest, a Hugging Face link, a GPU, a constraint. Use when the user wants a preset written or changed; the argument is the request.

Read SKILL.md at the source

Pinned to revision 2046ecc85212, so it is the text this page describes rather than whatever the author pushed since.

Files

Every link opens the file at its source, pinned to the revision this page describes.