Compute-Bound vs Memory-Bound
Reading the roofline to plan fixes.
Two Kinds of Limit
Every kernel hits one of two walls. It is either compute-bound, limited by math, or memory-bound, limited by data movement. ⚖️
Compute-Bound, Defined
A compute-bound kernel keeps the math units busy and rarely waits on memory. Its limit is raw arithmetic throughput.
All lessons in this course
- Timeline View in Nsight Systems
- Kernel Metrics in Nsight Compute
- Compute-Bound vs Memory-Bound
- Annotating Code with NVTX