Match Pictures to Words

Train a tiny CLIP in your browser with the real contrastive loss. Watch the similarity grid's diagonal form, then classify pictures zero-shot with labels it never trained on.

From Chapter 15: Multimodal AI