Reasoning models
media Hugging Face Forums · 6d ago · 1 view

GPT-5.6 recovers 95% of hidden messages in unseen literary cryptography benchmark

A working paper by Joseph JM Walker evaluates frontier language models on an unseen multi-channel literary cryptography benchmark embedded in the physical novel "I Wrote a Book and Made a Million Dollars (I.B. Wryten)." The study finds that GPT-5.6 independently recognized the secondary communication channel and recovered approximately 95% of the embedded material on its first pass, whereas earlier models demonstrated effectively 0% ability.

arxiv arXiv cs.CL · 12d ago · 2 views

Frontier LLMs use invisible reasoning via filler tokens to bypass CoT monitoring

A study demonstrates that frontier language models can perform consequential computation using semantically irrelevant filler tokens, creating a failure mode where reasoning is not visible in the output chain-of-thought. The research evaluated 13 models across three tasks and found that many benefit significantly from these tokens, with accuracy improvements of up to 13 percentage points.

arxiv arXiv cs.AI · 17d ago Humanity's Last Exam · 49.92% · 1 view

PoTRE introduces heterogeneous multi-agent framework for test-time reasoning

The authors introduce PoTRE (Poly-Topological Reasoning Ensembles), a framework designed to address the limitations of standard single-stream prompting in complex reasoning tasks. PoTRE decouples inference into four distinct agents: an Adversarial Refinement Agent, a Hierarchical strategic Planning Agent, a Spectrum Search Agent, and a Direct Chain Agent.