Why Context Changes Word Meaning
Bank the river vs bank the money.
Why Context Changes Word Meaning is a free NLP Academy lesson on CoddyKit — lesson 1 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the NLP Academy learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
One Word, Many Meanings
The word bank can mean a river edge or a place for money. Its meaning depends entirely on the context around it.
Static Vectors Fall Short
word2vec and GloVe give each word one fixed vector. So bank gets a single static meaning, no matter the sentence it appears in.
See the Problem
These two sentences use bank in opposite ways, yet a static model hands them the very same vector for the word.
s1 = "sit on the bank of the river"
s2 = "deposit cash at the bank"Humans Read Context
You instantly know which bank is meant because you read the surrounding words. Meaning lives in context, not in the word alone.
Enter Contextual Embeddings
A contextual model gives bank a different vector in each sentence. The embedding now shifts to fit its context every time. ✨
Meet BERT
BERT is a transformer that reads a whole sentence at once and produces context-aware vectors. It is built around attention over all the words.
Reading Both Directions
BERT looks at words on the left and the right of each token together. That two-way view is what bidirectional means.
Same Token, New Vector
Feed both river and money sentences to BERT and bank comes out with two distinct vectors. The embedding tracks the sentence.
Polysemy Solved
Words with many senses, called polysemy, used to confuse static models. Contextual embeddings finally separate those senses cleanly.
Why It Matters
Search, translation, and question answering all improve when a model truly grasps which meaning a word carries right now.
The Big Shift
Moving from one vector per word to one per usage was a turning point. This is the heart of modern NLP.
Quick Check
What makes contextual embeddings different from static ones?
Recap
Static vectors trap each word in one meaning. Contextual embeddings from BERT shift per sentence, capturing the right sense. ✅
Frequently asked questions
Is the “Why Context Changes Word Meaning” lesson free?
Yes — the full text of “Why Context Changes Word Meaning” is free to read here on the web, and the NLP Academy course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the NLP Academy course, upgrade to CoddyKit PRO.
What will I learn in “Why Context Changes Word Meaning”?
Bank the river vs bank the money. You practise NLP Academy with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start NLP Academy?
No prior experience is required. NLP Academy on CoddyKit is structured for beginners through advanced learners; this is — lesson 1 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “Why Context Changes Word Meaning” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this NLP Academy lesson?
Yes. Every NLP Academy lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.
All lessons in this course
- Why Context Changes Word Meaning
- Masked Language Modeling
- Embedding Sentences With BERT
- Picking the Right Pre-trained Model