LLM Apps
Ledger
Structured extraction from 40-page financial PDFs with schema validation and a confidence score per field, replacing a nine-person review team.
Extraction is a schema problem
The trick is not prompting — it is refusing to accept output that does not validate. Every extraction is parsed into a Pydantic model; a failure triggers a repair pass with the validation error included in the prompt.
Confidence that means something
Self-reported confidence from a model is close to worthless. What worked: extract each field twice with different context windows, and flag disagreement. That correlates with real error at r = 0.79.
Next