gensai.aiQuantization compresses an AI model by reducing the precision of the numbers that make up its weights, for example from 16 bits down to 4. The model loses a touch of finesse but becomes about four times lighter, and faster, letting it run on standard hardware rather than a specialised GPU server.
In practice at Gensai
Quantization is what allowed Gensai to run the “Monsters of the Oceans” installation fully locally on a simple Mac Mini.
Same theme
LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chainingPre-trained modelFoundation modelGenerative AITransformerTokenContext windowPromptPrompt engineeringContext (AI)Memory (AI)Fine-tuningOpen-weightDistillationLoRA (Low-Rank Adaptation)Mixture of Experts (MoE)Reasoning modelTemperature (AI)
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Chatbots and answer engines, Voice AI
55 boulevard de Strasbourg, 75010 Paris