A Token is the basic unit of text processed by a language model. A token may represent a word, part of a word, punctuation mark, or special symbol, depending on the model's tokenizer.
Voice AI platforms measure prompts, responses, costs, and context limits using tokens. Token usage directly affects inference speed, pricing, latency, and the maximum conversation context an AI model can handle.