A GPU, or graphics processing unit, is a chip designed to run thousands of calculations in parallel. It has become essential for training and running AI models. Its memory, the VRAM, determines how large a model it can load: at native precision, a 70-billion-parameter model requires a dedicated GPU server.
In practice at Gensai
Thanks to quantization, Gensai runs some models without a GPU server, like the “Monsters of the Oceans” installation on a simple Mac Mini.
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Custom AI solutions