Why Context Changes Word Meaning
Bank the river vs bank the money.
One Word, Many Meanings
The word bank can mean a river edge or a place for money. Its meaning depends entirely on the context around it.
Static Vectors Fall Short
word2vec and GloVe give each word one fixed vector. So bank gets a single static meaning, no matter the sentence it appears in.
All lessons in this course
- Why Context Changes Word Meaning
- Masked Language Modeling
- Embedding Sentences With BERT
- Picking the Right Pre-trained Model