Fig. 1 · Production RAG
AskMyDocs: Production-Grade RAG with CI-Gated Evaluation
Ask questions of your own PDFs and get answers with inline citations. Retrieval is hybrid (60% ChromaDB vector similarity, 40% BM25) with the top 10 candidates re-scored to the top 3 by an ms-marco-MiniLM-L-6-v2 cross-encoder. Any answer that comes back without citations is flagged as a hallucination, and prompt templates are versioned (default / strict / concise) and selectable per query. Every release is graded by an LLM judge in GitHub Actions: faithfulness under 0.70, relevance under 0.70 or citation rate under 0.80 fails the build and the version never ships. The whole pipeline is built as swappable modules (loader, chunker, embedder, vectorstore, reranker, LLM, prompts) so any stage can be ablated on its own. Live and public on Hugging Face Spaces.
| Metric | Gate |
|---|---|
| Retrieval mixvector similarity / BM25 | 60 / 40 |
| Faithfulnessbuild fails below this | ≥ 0.70 |
| Relevancebuild fails below this | ≥ 0.70 |
| Citation ratebuild fails below this | ≥ 0.80 |
LLaMA (Groq) · ChromaDB · BM25 · Cross-Encoder · GitHub Actions · Gradio