Loss as a Landscape to Descend
Picture error as hills and valleys.
Loss as a Landscape to Descend is a free Deep Learning Academy lesson on CoddyKit — lesson 1 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the Deep Learning Academy learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
What Loss Measures
Your model's loss is a single number that says how wrong its predictions are. Smaller loss means better predictions. Training is just the quest to shrink it. 📉
Loss Depends on Weights
The same data gives different loss depending on your weights. Change a weight and the loss moves up or down. So loss is really a function of the weights.
loss = compute_loss(weights, data)Picture a Landscape
Imagine every weight setting as a spot on a hilly landscape, and the height at that spot is the loss. Training means walking downhill to lower ground.
The Valley Is the Goal
The lowest point in this landscape is the minimum: the weights where your model predicts best. Your whole job is to reach that valley floor.
One Weight, a Simple Curve
With a single weight, the landscape is just a 2D curve. You can literally plot loss against the weight and see the dip where loss is smallest.
def loss(w):
return (w - 3) ** 2Two Weights, a Surface
Add a second weight and the curve becomes a 3D surface with hills and valleys. Real models have millions of weights, so the landscape lives in millions of dimensions.
You Can't See It All
In high dimensions you can never view the whole landscape at once. You only feel the slope right under your feet and step accordingly.
Steep vs Flat Ground
A steep slope means loss changes fast here, so a small step helps a lot. Flat ground means you are near a valley or a plateau and progress slows.
Not Every Valley Is the Best
The landscape can have many dips. A local minimum is a small valley that traps you above the deepest one. Deep nets usually still train well anyway.
Descending the Landscape
The whole training algorithm is called gradient descent for a reason: you repeatedly step downhill on this loss landscape until you settle near the bottom.
Why the Metaphor Helps
Thinking of loss as terrain makes training intuitive: where am I, which way is down, and how big a step should I take? Every other idea builds on this picture.
Quick Check
Let's check the landscape picture.
Recap
Loss is a number that depends on your weights, so it forms a landscape of hills and valleys. Training means walking downhill toward the lowest loss you can find. 🏔️
Frequently asked questions
Is the “Loss as a Landscape to Descend” lesson free?
Yes — the full text of “Loss as a Landscape to Descend” is free to read here on the web, and the Deep Learning Academy course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the Deep Learning Academy course, upgrade to CoddyKit PRO.
What will I learn in “Loss as a Landscape to Descend”?
Picture error as hills and valleys. You practise Deep Learning Academy with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start Deep Learning Academy?
No prior experience is required. Deep Learning Academy on CoddyKit is structured for beginners through advanced learners; this is — lesson 1 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “Loss as a Landscape to Descend” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this Deep Learning Academy lesson?
Yes. Every Deep Learning Academy lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.