GloVe and FastText Embeddings
Global co-occurrence statistics, subword FastText, loading pretrained embeddings.
Beyond Word2Vec
Word2Vec learns from local context windows. Two other influential embeddings take different approaches: GloVe uses global statistics, and FastText uses character pieces.
What Is GloVe
GloVe (Global Vectors) is trained on a global co-occurrence matrix: how often each pair of words appears together across the whole corpus, not just local windows.
All lessons in this course
- Word2Vec: Skip-gram and CBOW
- GloVe and FastText Embeddings
- Text Classification with BERT
- Semantic Similarity and Sentence Embeddings