← Quest map
Phase 3 · The Metal
Profiling & the Roofline
Nsight is your microscope; the roofline is your map.
0/6 · 450 XP
You’re previewing the curriculum. Sign in (top right) to track progress, take knowledge checks, and unlock the verifiers.
Tasks
Find the gaps between kernels — idle GPU time is the silent killer. Do it on a real model on your fleet.
SOL section, memory charts, occupancy. Learn to read what everyone screenshots.
Coalescing, occupancy, ILP — the optimization playbook, in one lecture.
watch+50 XPRidge points, arithmetic intensity of prefill vs decode, why batching works. 75% to pass.
drill+80 XPauto-verifiedLaunch-overhead elimination — this is why vLLM/TRT-LLM capture the decode step.
Record a snapshot of a real inference run, open it in memory_viz, and explain one allocation spike. Also learn the caching allocator and expandable_segments — fragmentation OOMs are real on-call work.