Why Sequences Need Memory
Order matters in text, audio, and time.
Order Carries Meaning
In a sequence, order is information. The words 'dog bites man' and 'man bites dog' use the same tokens but mean opposite things. 🐶
Sequences Are Everywhere
Text, audio, stock prices, and sensor readings are all sequences: ordered lists where each step relates to the steps around it.
All lessons in this course
- Why Sequences Need Memory
- The Vanilla RNN Cell
- LSTM & GRU Gates
- Pack Sequences & Handle Padding