Moving Data to and from Device
Manage host-device memory transfers.
Two Separate Memories
The CPU and GPU each have their own memory. The GPU cannot read your host arrays until the data lives on the device.
Host and Device
We call the CPU side the host and the GPU side the device. Moving data between them is a core part of GPU work.
All lessons in this course
- Why GPUs for AI Workloads
- Threads, Blocks, and Grids
- Writing a GPU Kernel Function
- Moving Data to and from Device