In more detail
AI doesn’t read text the way you do. Before a model like ChatGPT sees your message, the text gets broken into small chunks called tokens — sometimes a whole word, sometimes just part of one, plus punctuation. A word like ‘unbelievable’ might become three pieces: ‘un’, ‘believ’, ‘able’.
This matters because tokens are how AI is measured and billed. The price of a request, the size of a context window, the speed of a reply — all of it is counted in tokens. When people say a model is expensive, what they really mean is that its tokens are.
Goes with
