Skip to content
Road to Intelligence
← The Lab

Count the Next Word

Build a sentence with a count-based model: see exactly which words it looks at, which corpus lines it counts, and how the chain rule multiplies each step.

From Chapter 6: Language Before Transformers

Try it · toy model

Count the Next Word

Know well8 min