On Device takes the logic one step further: the model runs directly on the device (computer, kiosk, mobile), with no remote server at all. Zero data transmitted, offline operation, minimal latency and energy frugality: the ideal approach for autonomous installations.
In practice at Gensai
Gensai's “Monsters of the Oceans” installation runs entirely On Device on a Mac Mini, with no Internet connection.
When should AI run on the device?
When the system must work without a network (kiosk, temporary installation, poorly covered venue), when no data may leave the device, or when every tenth of a second counts in the exchange. Small models and quantised versions of large models make this approach possible on a recent computer or kiosk.
Common mistake
Forgetting maintenance. An embedded model does not update itself: you need to plan how to replace it, how to refresh the knowledge base and how to monitor it without a permanent connection.
Same theme
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Voice AI, Custom AI solutions