InferQuest
← Quest map
Phase 2 · Engine Core

Batching & Scheduling

Continuous batching is why serving companies exist.

0/4 · 260 XP
You’re previewing the curriculum. Sign in (top right) to track progress, take knowledge checks, and unlock the verifiers.
Tasks
  • Pair with Anyscale's continuous-batching explainer (anyscale.com/blog/continuous-batching-llm-inference).

    paper+60 XPresource ↗
  • The founding document of modern serving: KV fragmentation → paged blocks. Non-negotiable.

    paper+70 XPresource ↗
  • Stall-free scheduling — now default in vLLM V1.

    paper+50 XPresource ↗
  • TTFT vs ITL, continuous batching, chunked prefill, prefix caching. 75% to pass.

    drill+80 XPauto-verified