2 min read
RAG is a retrieval problem, not a prompting problem
Two-thirds of the accuracy gain in our production RAG system came from changes upstream of the model. Here is the measured breakdown, and what to fix in what order.
Topic
Evaluation
How to know whether an AI system actually got better.
1 min read
How to evaluate an LLM system without fooling yourself
Vibes-based evaluation is how teams ship regressions. A practical framework: golden sets, calibrated judges, regression gates, and the failure modes of each.