Prompt injection is an attack that manipulates a language model's textual instructions to bypass its rules: making it ignore its safety guidelines or reveal internal information. Unlike classic attacks, it exploits the model's linguistic logic, which calls for specific defences.
In practice at Gensai
Gensai secures its systems by structuring prompts, filtering inputs and strictly limiting agents' access rights and allowed actions.
Definition written with AI assistance, checked by Sébastien Lecocq, co-founder of Gensai.
Going beyond the definition?
From concept to project: Gensai builds custom, sovereign, GDPR-compliant AI solutions.
Related services: Chatbots and answer engines, Custom AI solutions