Week 5 lab · about 45 minutes

RAG Pipeline Lab: the poisoned document

AskIT is a (simulated) company helpdesk bot. It searches the IT knowledge base, pastes the best matches into its prompt, and answers. First ask normal questions. Then let an attacker upload a poisoned document and watch what happens. Finally, switch on defenses.

1. Ask AskIT

Attacker controls

Defenses

Pipeline

  1. Question received
  2. Search knowledge base (vector DB)
  3. Build prompt
  4. Model writes answer
  5. Output check

2. Search results (top 2 are used)

Ask a question first.

3. Prompt sent to the model

—

Lab goals