Reducing Memory Traffic
Keep data close to the compute.
Why Memory Matters
Modern CPUs compute far faster than they can fetch data. Often a kernel waits on memory, not on the math itself.
What Is Memory Traffic?
Memory traffic is the total bytes your kernel reads and writes. Less traffic per result usually means a faster kernel.
All lessons in this course
- Anatomy of a Compute Kernel
- Combining SIMD with Loops
- Reducing Memory Traffic
- Tiling for Cache Locality