A study compares full-corpus injection against two structured retrieval modes for analyzing transactional legal documents: embedding retrieval (NAVEMBED) and LLM navigation over a compact index (NAVINDEX). On a 20-question benchmark, both retrieval methods tied with injection on semantic accuracy while significantly reducing token usage.
- NAVEMBED tied injection on 16 of 18 document-bound questions while attending to 17.3x fewer input tokens.
- NAVINDEX tied injection on all 18 questions with a 1.61x smaller total token footprint and approximately 56x smaller answering context.
- NAVINDEX achieved 25% lower dollar cost compared to the injection baseline.
The authors derive a closed-form caching-crossover rule, noting that cached injection is only cheaper when the corpus remains below roughly ten times the retrieval payload.