2 min read
RAG is a retrieval problem, not a prompting problem
Two-thirds of the accuracy gain in our production RAG system came from changes upstream of the model. Here is the measured breakdown, and what to fix in what order.
Topic
Large language models: architecture, fine-tuning, serving and cost.
Two-thirds of the accuracy gain in our production RAG system came from changes upstream of the model. Here is the measured breakdown, and what to fix in what order.
Vibes-based evaluation is how teams ship regressions. A practical framework: golden sets, calibrated judges, regression gates, and the failure modes of each.
The question is not which is better. It is which failure you are trying to fix — missing knowledge, wrong behaviour, or unacceptable cost.