Glossary

Prompt injection

Definition

Prompt injection uses untrusted instructions to make an AI system depart from its intended task or misuse its access.

Instructions can arrive directly from a person or indirectly inside a document, email or web page the AI reads. Consequences depend on the system's permissions.

A customer may include “Prompt injection” in a supplier security questionnaire or spreadsheet. They want to understand whether this topic affects the service you provide and what safeguards or evidence support your answer.

Prompt injection is an attempt to make an AI system follow untrusted instructions that conflict with its intended task. The instructions may come from a person using the system directly or be embedded in material it reads, such as a document or website.

The risk grows when an AI assistant can retrieve private information, send messages or change records. Text that should be treated as content can instead influence an action. Even without connected tools, injection can distort a summary or answer. It is distinct from an ordinary factual mistake in the model's response.

Hypothetical example: a small business asks an assistant to summarise supplier proposals. One proposal contains hidden instructions intended to make the assistant favour that supplier or disclose information from another document. The document should not have authority over the assistant's task.

Give AI services only the information and permissions needed for their work, and require suitable checks before sensitive actions. Treat text from documents, web pages and user input as untrusted data. Limit what an AI system can access or change, test whether embedded instructions alter its behaviour, and require human approval before sensitive actions. Filtering alone is not a complete safeguard. Filtering prompts alone is not a complete guarantee. The business also needs to decide which decisions require a person, especially when the assistant can act on external systems.

Sources: OWASP GenAI Security Project: prompt injection.