Lecture 12 : Learning Word Representation - Part 1
Learning Word Vectors: Overview
Two Variations: CBOW and Skip-grams
Word2Vec (Skip-gram) Overview
Example windows and process for computing P(wt+j |wt )
Word2Vec (Skip-gram) Overview
Example windows and process for computing P(wt+j |wt )
Word2Vec: objective function
Understanding P(o|c) further
More Explanation
More Explanation
Try this problem
Try this problem
Gradient Descent for Parameter Updates
Training the model
Training the model
Source: https://web.stanford.edu/class/cs224n/slides/cs224n-spr2024-lecture01-wordvecs1.pdf
Source: https://web.stanford.edu/class/cs224n/slides/cs224n-spr2024-lecture01-wordvecs1.pdf
Source: https://web.stanford.edu/class/cs224n/slides/cs224n-spr2024-lecture01-wordvecs1.pdf
Source: https://web.stanford.edu/class/cs224n/slides/cs224n-spr2024-lecture01-wordvecs1.pdf
Source: https://web.stanford.edu/class/cs224n/slides/cs224n-spr2024-lecture01-wordvecs1.pdf
Visualization
Issues with word2Vec
Daniel Jurafsky and James H. Martin. 2024. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models, 3rd edition. Online manuscript released August 20, 2024. [Chapter 6]