Engineering
4 min read
Your RAG System Is Not Hallucinating. It Is Retrieving Badly.
When a retrieval system returns a confident wrong answer, the instinct is to blame the model or rewrite the prompt. Usually the model answered correctly from bad context. Four things fix more wrong answers than any prompt change.