Creating and Using Streams

A non-default stream is your own work queue. Two streams run independently, so the GPU can make progress on both at once. 🧵

A stream lives in a cudaStream_t handle. You create it once, pass it to your calls, and destroy it when you are done.