ExtractConf: Multi-Signal Confidence Engine for LLM Document Extraction
ExtractConf introduces a confidence engine that uses dual LLM readings—field-guided and document-guided—to detect unreliable extractions. It fuses disagreement between calls, LLM uncertainty, and document signals into a classifier, achieving 0.928 ROC AUC on invoices and reducing selective prediction risk by 70%.