← Quest map
Phase 2 · Engine Core
Long Context & KV Policy
When the cache can't hold everything, something has to give.
0/3 · 190 XP
You’re previewing the curriculum. Sign in (top right) to track progress, take knowledge checks, and unlock the verifiers.
Tasks
The two poles of KV retention policy: keep the start + a sliding window, or keep what attention actually uses. Both ship as engine features.
Gemma's sliding window and Mamba/hybrid layers need different block layouts — vLLM's hybrid KV manager is the production answer.
Map the design space beyond quantization. Also skim sparse-attention serving (MInference-class) and prompt compression.