Common GloVe equation has an error?

51 views
Skip to first unread message

Nicholas Gunther

unread,
Aug 22, 2023, 7:12:22 PM8/22/23
to GloVe: Global Vectors for Word Representation
One common GloVe equation (see, for example, slide 24 of the public slides for the second lecture in Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 2 - Neural Classifiers )  is:

w_i \dot w_j = log P(i | j)

Image:
Screenshot 2023-08-22 160936.png

BUT in general this is wrong.  As a dot product, the left-hand side is commutative in i, j while as a conditional probability, the right hand side is not. 
Can someone indicate the correct statement?  Or please tell me what I'm missing?
Thanks!
- Nick
Reply all
Reply to author
Forward
0 new messages