Lesson deck
Production deployment of RAG flashcards
Reviewing needs JavaScript. You can read every card in the list below.
Loading your cards...
Back to the lesson4 cards in this deck
Read all 4 cards as a list
- Front
- What makes RAG ingestion safe to operate?
- Back
- It is idempotent (content-hash ids), incremental, propagates deletes with tombstones, and records the embedding model and chunker version on every chunk.
- Front
- How do you re-embed a corpus with zero downtime?
- Back
- Build a new index version in the background with the new model, run the eval gate, then swap the alias together with the query-side model. Keep the old version for a one-step rollback.
- Front
- How do you size a vector index?
- Back
- Raw size is vectors x dimensions x bytes per value (10M x 768 x 4 B is about 31 GB) before index overhead. That decides RAM versus disk, quantization and sharding. Shard for size, replicate for query rate.
- Front
- Why can output guardrails conflict with streaming?
- Back
- Streamed text is shown before it can be fully checked. Choose check-first (slower first token), stream-first (risk of showing unchecked text) or check in chunks.