Distributed Representation (Word Embeddings)
Dense Vector Representation
Word
Dim 1
Dim 2
Dim 3
"king"
0.25
0.80
0.45
"queen"
0.30
0.85
0.50
"apple"
0.60
0.10
0.70
"banana"
0.55
0.15
0.75
3D Embedding Space
Dim 1
Dim 2
Dim 3
king
queen
apple
banana
Royalty cluster
Fruit cluster
Key Properties of Distributed Representations:
• Similar words cluster together in the embedding space
• Each dimension contributes to multiple semantic concepts