Lesson deck
Guardrails, safety and prompt injection flashcards
Reviewing needs JavaScript. You can read every card in the list below.
Loading your cards...
Back to the lesson4 cards in this deck
Read all 4 cards as a list
- Front
- What is prompt injection?
- Back
- Text that changes what a model does in a way its operator did not intend. It can arrive through the user or through content the model reads.
- Front
- Core defence principle against prompt injection?
- Back
- Treat retrieved and tool-returned content as data, never as instructions, and assume some injections will still succeed, so limit what a hijacked model can do.
- Front
- Direct vs indirect prompt injection?
- Back
- Direct: the user's own input is the attack. Indirect: an innocent user's agent reads third-party content (web page, email, retrieved document, tool output) that carries hidden instructions.
- Front
- False positive vs false negative in a guardrail?
- Back
- False positive: a legitimate request is blocked. False negative: an attack passes. A stricter threshold trades one for the other, so set it by the cost of each failure.