The context window is the maximum amount of text (in tokens) a model can take into account at once: the conversation, the supplied documents, its own answers. Beyond it, information falls out of scope. Its size conditions the ability to work on long documents and keep track of an exchange.
In practice at Gensai
Gensai designs its RAG systems to inject only the useful passages into the window: more precise, faster and cheaper.
Same theme
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Chatbots and answer engines, Voice AI