Phase 3 · The Metal

CUDA Foundations

PMPP + GPU MODE: the canonical on-ramp.

0/5 · 450 XP

You’re previewing the curriculum. Sign in (top right) to track progress, take knowledge checks, and unlock the verifiers.

Tasks

PMPP chapters 1–6: execution model, memory hierarchy, occupancy
5th edition (2026) if buying fresh; 4th is fine. These six chapters are the core.
read+120 XPresource ↗
GPU MODE lectures 1–4: profiling, PMPP recap, compute & memory architecture
The de facto open curriculum for this job. Join the Discord while you're there — it posts jobs.
watch+80 XPresource ↗
Solve GPU Puzzles
Thread-indexing drills, zero setup on Colab.
kernel+100 XPresource ↗
Watch “How GPU Computing Works” + “How CUDA Programming Works” (GTC)
Stephen Jones' talks — the best conceptual account of why GPUs are shaped this way.
watch+50 XPresource ↗
Write and launch your first kernels: vector add, then naive matmul
CUDA C++ via torch.utils.cpp_extension.load_inline, per GPU MODE lecture 1.
kernel+100 XP