블록이 존재하는 이유

You might wonder why CUDA bothers grouping threads into blocks at all. The answer is about scheduling and scaling. 🤔

The GPU hands out whole blocks to its streaming multiprocessors. A block is the chunk of work the hardware schedules as one piece.

Blocks must run independently, in any order, with no guaranteed communication. This rule is what makes a kernel portable across GPUs.

A small GPU runs a few blocks at a time; a big one runs many. Independence lets the same code scale without you changing a line.

Threads in the same block share fast on-chip memory and can synchronize. That tight teamwork is only possible because they stay together.

A barrier like __syncthreads only works inside a block. There is no built-in way to sync across the whole grid mid-kernel.

If blocks could all wait on each other, the GPU could deadlock when it cannot fit them at once. Keeping blocks independent avoids that.

When one block stalls on memory, the scheduler swaps in another ready block. Having many blocks keeps the cores busy.

Registers and shared memory are allotted per block. Smaller blocks let more of them fit on a multiprocessor at the same time.

A healthy launch uses many more blocks than the GPU has multiprocessors. Extra blocks give the scheduler room to balance work.

So blocks trade global cooperation for huge scalability. You give up cross-block sync and gain code that runs on any GPU.

Think about what block independence buys you.

You saw why blocks exist: they are the schedulable, independent unit that delivers scalability, while threads inside cooperate closely. 🚀