How an RNN Reads a Sequence
Hidden state carries the past.
One Word at a Time
A recurrent neural network reads text like you do, taking one token, then the next, never the whole sentence in one gulp.
The Hidden State
At each step the RNN keeps a small memory called the hidden state, a vector summarizing everything it has read so far.
All lessons in this course
- Why Order Matters in Language
- How an RNN Reads a Sequence
- Building an RNN Text Model
- The Vanishing Gradient Problem