Researchers propose R3Con, a harness that operationalizes cognitive theory principles for constructing effective representations of very large contexts. The system addresses the challenge of assembling interdependent information scattered across vast sources beyond standard model context limits.

  • Evaluated against nine baselines on two benchmarks for reasoning over large document corpora.
  • Outperforms the strongest baseline by 20 and 8.4 percentage points respectively.
  • Enables smaller models to outperform larger ones: R3Con with 4B and 9B models beats all evaluated 35B baselines.
  • R3Con with a 35B-A3B model outperforms Claude Code with Claude-Sonnet-5 at 3.7x lower cost.

The results indicate that context representations following these principled approaches can reduce reliance on model scale, pointing toward frontier-level performance powered by smaller models.