Train a tiny 2-D word2vec live in your browser and watch words that share neighbours drift together; compare with one-hot IDs, where nothing transfers.
From Chapter 6: Language Before Transformers
Try it · toy model
Train Word Vectors
Read the concepts