AI Engineering · RAG · Grounded QA
Cloud Analytics Knowledge Search — RAG & Hybrid Retrieval
Hybrid TF-IDF + dense retrieval over a synthetic enterprise corpus, with extractive answers, document citations and honest abstention.
- Problem
- Let analysts ask questions over enterprise documents and get answers they can trust — with citations, or an honest “not supported by the knowledge base”.
- Architecture
- Synthetic 300-document corpus → chunking → TF-IDF sparse + dense (sentence-transformers) hybrid fusion → extractive answer generation → Streamlit UI.
- Implementation
- A 40-question eval set measures all three paths (TF-IDF, dense, hybrid). The extractive generator copies answer sentences from retrieved context with document citations and abstains below the evidence threshold. No LLM is called anywhere.
- 300 synthetic enterprise documents
- 87.5% recall@1 — hybrid leads on the top answer; dense leads the full ranking (recall@5 97.5%, MRR 0.906)
- Grounded answers with citations; abstains on unsupported questions
- 24 passing tests, 40-question evaluation set
Design note: corpus and questions are synthetic. Answers are extractive by design — grounded in retrieved documents with citations, so every answer can be verified against its source. Bedrock/LangChain are documented integration points; the Docker image was not built in this environment.
View Repository