The context window is the maximum amount of text (in tokens) a model can take into account at once: the conversation, the supplied documents, its own answers. Beyond it, information falls out of scope. Its size conditions the ability to work on long documents and keep track of an exchange.
In practice at Gensai
Gensai designs its RAG systems to inject only the useful passages into the window: more precise, faster and cheaper.
Same theme
LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chainingPre-trained modelFoundation modelGenerative AITransformerTokenPromptPrompt engineeringContext (AI)Memory (AI)Fine-tuningOpen-weightQuantizationDistillationLoRA (Low-Rank Adaptation)Mixture of Experts (MoE)Reasoning modelTemperature (AI)
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
55 boulevard de Strasbourg, 75010 Paris