gensai.aiThe token is the unit of text a language model works with: a short word, a word fragment, a punctuation mark. Text is split into tokens before processing. API billing, context window size and generation speed are all counted in tokens.
In practice at Gensai
Gensai sizes its architectures in tokens: document chunking for RAG, control of API costs and latency.
Same theme
LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chainingPre-trained modelFoundation modelGenerative AITransformerContext windowPromptPrompt engineeringContext (AI)Memory (AI)Fine-tuningOpen-weightQuantizationDistillationLoRA (Low-Rank Adaptation)Mixture of Experts (MoE)Reasoning modelTemperature (AI)
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Chatbots and answer engines, Voice AI
55 boulevard de Strasbourg, 75010 Paris