The Vanilla RNN Cell
Carry a hidden state across steps.
What a Cell Does
An RNN cell is the tiny engine that runs at each time step. You feed it one input and the old memory, and it returns the new memory.
Two Inputs Per Step
Every step the cell takes two things: the current input x and the previous hidden state. It mixes them into a fresh hidden state.
All lessons in this course
- Why Sequences Need Memory
- The Vanilla RNN Cell
- LSTM & GRU Gates
- Pack Sequences & Handle Padding