Forward Pass, Loss, Backward, Step
The four moves of one training iteration.
Four Moves, One Beat
Every training iteration is just four moves repeated: forward, loss, backward, step. Learn this rhythm and the whole training loop stops feeling mysterious. 🥁
Move One: Forward
The forward pass sends your input through the model so it produces a prediction. You just call the model on a batch of data and read the output.
pred = model(x)All lessons in this course
- Forward Pass, Loss, Backward, Step
- Write a Minimal Training Loop
- Track Accuracy While You Train
- Train vs Eval Mode