Concepts
Concept

Tokens

Tokens are the small chunks that AI breaks text into before processing it. A common word like "cat" is a single token, but a long or rare word might be split into several tokens. This matters because AIs have a limit on how many tokens they can read at once (the "context window"), and paid services charge by the number of tokens used. Basically, the longer your text, the more tokens it takes, the more it costs.