gensai.aiThe token is the unit of text a language model works with: a short word, a word fragment, a punctuation mark. Text is split into tokens before processing; API billing, context window size and generation speed are all counted in tokens.
In practice at Gensai
Gensai sizes its architectures in tokens: document chunking for RAG, control of API costs and latency.
Same theme
LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chainingPre-trained modelFoundation modelGenerative AITransformerContext windowPromptPrompt engineeringContext (AI)Memory (AI)Fine-tuningOpen-weightQuantizationDistillationLoRA (Low-Rank Adaptation)Mixture of Experts (MoE)Reasoning modelTemperature (AI)
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
55 boulevard de Strasbourg, 75010 Paris