CPU vs GPU: Latency vs Throughput
How a few big cores differ from thousands of tiny ones.
Two Very Different Chips
A CPU and a GPU both run code, but they are built for opposite goals. One races to finish a single task; the other floods a wall of work all at once. 🏎️
Latency: How Fast One Thing Finishes
Latency is the time it takes to complete one single task from start to end. When you want one answer right now, low latency is what you care about.
All lessons in this course
- CPU vs GPU: Latency vs Throughput
- SIMT: The Same Instruction, Many Threads
- What CUDA Actually Is
- Problems That Love the GPU