Why Order Matters in Language
The limits of bag-of-words models.
Order Carries Meaning
In language, word order is not decoration. Move the words around and the whole message can flip to something new.
A Classic Example
Dog bites man and man bites dog share the exact same words, yet only order tells you who did the biting.
All lessons in this course
- Why Order Matters in Language
- How an RNN Reads a Sequence
- Building an RNN Text Model
- The Vanishing Gradient Problem