Temperature is a setting that controls how much randomness goes into a language model's choice of words. Close to zero, the model almost always picks the most likely word and its answers are stable. The higher it goes, the more varied and creative the answers become, at the risk of drifting from the facts.
In practice at Gensai
Compliance chatbots designed by Gensai run at a low temperature to guarantee consistent answers, while storytelling experiences allow more variation.
Same theme
LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chainingPre-trained modelFoundation modelGenerative AITransformerTokenContext windowPromptPrompt engineeringContext (AI)Memory (AI)Fine-tuningOpen-weightQuantizationDistillationLoRA (Low-Rank Adaptation)Mixture of Experts (MoE)Reasoning model