vot-serve
Serve a vLLM preset on the current vllm-on-tap environment - resolve the preset (custom or builtin), start vLLM on the environment's stack as unit vot-<preset>, wait until it answers, and print the endpoint with a ready-to-paste request. Use when the user wants a preset running; the argument is the preset name.
Pinned to revision 2046ecc85212, so it is the text this page describes rather than whatever the author pushed since.
Files
Every link opens the file at its source, pinned to the revision this page describes.