Inference

AI fundamentals

Inference is the use of an already-trained model: given an input, it produces its output. Every chatbot answer is an inference. Its cost (latency, energy, price per token) is a central criterion when sizing an AI solution for production.

In practice at Gensai

Gensai optimises inference costs by choosing the right model size, down to the fully local inference of the Oceans installation.

Same theme

Artificial intelligence (AI)Algorithm Data Dataset Model (AI)Machine learning Deep learning Neural network Supervised learning Unsupervised learning Reinforcement learning Classification Regression Prediction Training Parameters Hyperparameters Bias (AI)

Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.

Going beyond the definition?

From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.

Related services: Custom AI solutions, AI agents

hello@gensai.ai

Tel. : +33 1 62 04 59 32

55 boulevard de Strasbourg, 75010 Paris

Book a 30-minute call

Inference

In practice at Gensai

In application

Same theme

Going beyond the definition?