Threads, Blocks, and Grids

A GPU runs your kernel as many tiny workers. Each single worker is a thread, and it usually handles one piece of data.

Threads are organized into a block. Threads in the same block can cooperate and share fast on-chip memory.