together-dedicated-model-inference
Deploy and operate models on dedicated GPUs with Together AI's Dedicated Model Inference (DMI, the v2 dedicated endpoints API): beta endpoints, deployments, deployment profiles and hardware configs, autoscaling, traffic splitting, A/B tests, shadow experiments, Prometheus metrics, and custom model or LoRA adapter uploads. Reach for it whenever the user mentions together beta endpoints or tg beta commands, client.beta.endpoints, DMI resources like ep_/dep_/cr_/ml_ IDs, or wants production model serving with traffic management on Together AI. This is the current dedicated-hosting API and also covers migrating off the retired legacy v1 endpoints API (non-beta client.endpoints / together endpoints), whose create and restart now return HTTP 403.
Pinned to revision 4e8964e24a5a, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/together-dedicated-model-inference/SKILL.md
- skills/together-dedicated-model-inference/references/api-reference.md
- skills/together-dedicated-model-inference/references/cli-reference.md
- skills/together-dedicated-model-inference/references/models-and-configs.md
- skills/together-dedicated-model-inference/references/traffic-routing.md
- skills/together-dedicated-model-inference/scripts/deploy_model.py
- skills/together-dedicated-model-inference/scripts/upload_custom_model.py
Every link opens the file at its source, pinned to the revision this page describes.