Ingestion
Parse files, normalize text, split chunks, create embeddings, and store chunk metadata. Treat ingestion as a repeatable pipeline, not a one-off script.
Protected Module
Retrieval augmented generation combines document ingestion, vector retrieval, prompt assembly, citations, and evaluation.
Parse files, normalize text, split chunks, create embeddings, and store chunk metadata. Treat ingestion as a repeatable pipeline, not a one-off script.
Retrieve candidates, remove duplicates, preserve source titles, and build a context packet that fits the model's input window.
Answer using only the provided sources.
If sources do not contain the answer, say so.
Return:
- answer
- cited_sources
- confidence
- missing_infoBuild a RAG endpoint over a folder of notes. Run ten questions and classify each failure as ingestion, retrieval, prompt, or source-data issue.