Demo: an incident where the assistant revealed another customer's order
On This Lesson 3 topics
This lesson is planned. The outline below lists the topics it will cover. The full lesson has not been published yet.
In this lesson
run the incident end to end on the order-support assistant; prepares SRC-022-LAB1.
Draft outline details
Step by step
- A customer reports seeing someone else's order details; declare the incident and a commander.
- Trigger the kill switch; time it and confirm the feature is off.
- Use logged config IDs and retrieved document IDs to find the cause: retrieval searched all orders and relied on the prompt to filter by customer.
- Planned mistake: fix it by adding "never reveal other customers' data" to the prompt. Fix: enforce authorization in the retrieval and tool layer by the caller's identity.
- Assess affected users from logs, involve security and privacy, and prepare notifications.
- Re-enable behind a canary after an evaluation gate with cross-customer test cases; write the postmortem.
Check your understanding
Where should access control for customer data live?
Show answer
In deterministic code on the data path, not in the prompt.
Practice
Apply this lesson with the module's lab, exercises and quiz.
Marking a lesson complete is optional and you can undo it any time. Your progress stays in this browser.