Token

The unit of text a model actually reads and writes — usually a word fragment, not a word.

Models do not process characters or words. They process tokens, which sit between the two and typically average three to four characters of English. Common words get a single token; rarer ones split into reusable fragments.

This is why letter-level tasks are genuinely hard for models, why arithmetic is awkward, and why the same sentence can cost several times more in one language than another.