← Quest map
Phase 6 · Production
SGLang & the Benchmark
Two engines, one methodology, publishable numbers.
0/6 · 890 XP
You’re previewing the curriculum. Sign in (top right) to track progress, take knowledge checks, and unlock the verifiers.
Tasks
Prefix-tree KV reuse. SGLang is co-equal with vLLM in job postings — know both.
TTFT, ITL/TPOT, goodput, and the measurement pitfalls. Realistic length distributions or it doesn't count.
Latency-throughput Pareto curves, TTFT/ITL separated, goodput at a stated SLO, cost/M tokens.
bench+200 XPInferQuest streams real completions against your endpoint and takes medians of 3 runs: TTFT ≤ 800ms and ≥ 25 tok/s single-stream. Tune until it passes.
bench+250 XPauto-verifiedThe post no laptop-bound candidate can write — real hardware, real methodology, reproducible configs.
write+200 XPauto-verified