.png)
Token
The basic unit of text processing in LLMs — typically a word, subword, or character that models use for input and output.
TL;DR
- —The basic unit of text processing in LLMs — typically a word, subword, or character that models use for input and output.
- —Understanding Token is critical for effective AI for companies.
- —Remova helps companies implement this technology safely.
In Depth
Tokens are the fundamental units that LLMs process. A token can be a complete word, part of a word, or a punctuation mark. GPT models use roughly 1 token per 0.75 words. Token counts directly impact costs (providers charge per token) and capabilities (context windows are measured in tokens). Understanding tokenization is essential for AI cost management.
Related Terms
Inference Cost
The computational cost of running a query through an AI model, typically measured per token.
Context Window
The maximum amount of text (measured in tokens) that an AI model can process in a single conversation.
Large Language Model (LLM)
A deep learning model trained on vast text datasets that can understand and generate human-like text.
AI FinOps
The practice of managing and optimizing AI and LLM costs through financial governance, budgeting, and usage analytics.
Glossary FAQs
BEST AI FOR COMPANIES
Experience enterprise AI governance firsthand with Remova. The trusted platform for AI for companies.
Sign Up