hyperloom-workload-optimizer
Autonomously optimizes end-to-end LLM inference throughput on AMD Instinct GPUs and reports a validated gain, using the Hyperloom multi-agent optimizer. Given a model, framework, workload (TP/EP, concurrency, ISL/OSL, precision), an objective and a time budget, it explores per-workload which levers to pull (serving/config parameters and env, framework enablement and source patches, and hot GPU-kernel rewrites), benchmarks each candidate, and returns the optimization stack that produced the gain. Use when the user wants to make a model serve faster, raise tokens/sec or throughput, optimize or tune vLLM or SGLang on MI300X/MI325X/MI355X, run Hyperloom, run the kernel-agent, quantize-then-optimize with Quark, set up Hyperloom from scratch, or resume a Hyperloom session. Do not use to stand up a server for plain serving, diagnose a broken ROCm install, or run a one-off kernel/benchmark or trace analysis without the optimization loop.
Pinned to revision 4e8964e24a5a, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/hyperloom-workload-optimizer/SKILL.md
- skills/hyperloom-workload-optimizer/LICENSE
- skills/hyperloom-workload-optimizer/evals/evals.json
- skills/hyperloom-workload-optimizer/evals/machine.yml
- skills/hyperloom-workload-optimizer/reference.md
- skills/hyperloom-workload-optimizer/scripts/_env.sh
- skills/hyperloom-workload-optimizer/scripts/launch.sh
- skills/hyperloom-workload-optimizer/scripts/launch_health.sh
- skills/hyperloom-workload-optimizer/scripts/preflight.py
- skills/hyperloom-workload-optimizer/scripts/resume.sh
- skills/hyperloom-workload-optimizer/scripts/tests/test_launch_flow.sh
- skills/hyperloom-workload-optimizer/scripts/tests/test_preflight.py
- skills/hyperloom-workload-optimizer/setup.md
- skills/hyperloom-workload-optimizer/skill-card.md
Every link opens the file at its source, pinned to the revision this page describes.