RAG Pipeline Lab: the poisoned document
AskIT is a (simulated) company helpdesk bot. It searches the IT knowledge base, pastes the best matches into its prompt, and answers. First ask normal questions. Then let an attacker upload a poisoned document and watch what happens. Finally, switch on defenses.
1. Ask AskIT
Attacker controls
Defenses
Pipeline
- Question received
- Search knowledge base (vector DB)
- Build prompt
- Model writes answer
- Output check
2. Search results (top 2 are used)
Ask a question first.
3. Prompt sent to the model
—