计算受限与内存受限
读取屋顶线图，规划改进方案
计算受限与内存受限 是 CoddyKit 上的免费 CUDA Academy 课时。 这是第 3 节课，共 4 节。 你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。 这是 CUDA Academy 学习路径的一部分，你的进度在网页和 CoddyKit 应用中同步。 CUDA Academy 课程共包含 4 节课。
本课时的部分内容尚未翻译，以英文显示。
Two Kinds of Limit
Every kernel hits one of two walls. It is either compute-bound, limited by math, or memory-bound, limited by data movement. ⚖️
Compute-Bound, Defined
A compute-bound kernel keeps the math units busy and rarely waits on memory. Its limit is raw arithmetic throughput.
Memory-Bound, Defined
A memory-bound kernel spends its time waiting for data. The cores sit idle while bytes crawl in from global memory.
Arithmetic Intensity
The key ratio is arithmetic intensity: math operations done per byte loaded. High intensity leans compute, low leans memory.
The Roofline Picture
On a roofline plot, low-intensity kernels hit the sloped memory ceiling, while high-intensity ones hit the flat compute ceiling.
Why Diagnosis Matters
Fixing the wrong wall wastes effort. Adding math to a memory-bound kernel changes nothing; you must cut data traffic instead.
Fixing Memory-Bound Kernels
To speed a memory-bound kernel, coalesce accesses, reuse data in shared memory, and cache values to read less.
Fixing Compute-Bound Kernels
For compute-bound work, raise parallelism, use faster math, or reach for tensor cores to push past the math ceiling.
Most Kernels Are Memory-Bound
In practice, the majority of CUDA kernels are memory-bound. Bandwidth, not arithmetic, is usually the scarce resource.
Let the Profiler Decide
Do not guess the wall. The roofline in Nsight Compute places your kernel under the correct ceiling for you.
A Simple Mental Test
Ask one question: are the cores or the memory pipes closer to peak? Whichever is saturated names your bound.
Quick Check
A kernel has very low arithmetic intensity.
Recap
Diagnose the wall first: memory-bound kernels need less traffic, compute-bound ones need more math. The roofline tells you which. 👏
常见问题解答
「计算受限与内存受限」课时是免费的吗？
是的 — 「计算受限与内存受限」的完整文本可在网页上免费阅读。要进行交互式练习（内置代码编辑器和全天候 AI 导师）并解锁 CUDA Academy 课程的其余内容，请升级到 CoddyKit PRO。 CUDA Academy 课程共包含 4 节课。
「计算受限与内存受限」这节课中我会学到什么？
读取屋顶线图，规划改进方案 你通过在浏览器中直接运行的动手代码来练习 CUDA Academy，全天候 AI 导师会在你学习这节课的过程中回答你的问题。
学习 CUDA Academy 需要有经验吗？
无需任何先前经验。CoddyKit 上的 CUDA Academy 课程适合初学者到高级学习者，你可以从这里开始或从头开始，按照自己的节奏学习。 这是第 3 节课，共 4 节。
「计算受限与内存受限」课时需要多长时间？
大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动，所以你能稳步进步，并在网页和应用中从离开的地方继续。
我能在这节 CUDA Academy 课中编写并运行代码吗？
能。每节 CUDA Academy 课都包含内置代码编辑器，你可以在浏览器中直接编写并运行真实代码，并获得即时 AI 反馈 — 无需本地设置。