Benchmark results
lab Hugging Face Blog · 1d ago · 14 views

AISI releases verified evaluation results for six frontier models on five benchmarks

The UK AI Security Institute (AISI) has made publicly reported evaluation methods and findings available through EvalEval's Evaluation Cards platform to improve benchmark reproducibility. This release includes verified results, context, and configuration information for five specific benchmarks: HealthBench, FrontierMath, Humanity's Last Exam, SWE-Bench Pro, and Terminal-Bench 2.0.

media MarkTechPost · 8d ago LMSYS Arena (Elo) · 1866.0Elo · 22 views

Prior Labs releases TabPFN-3.5, beating 2015 Otto Kaggle winner with default settings

Prior Labs has released TabPFN-3.5, a tabular foundation model that predicts on a table in a single forward pass without per-dataset training or tuning. The model scores 0.375 on the private leaderboard of the 2015 Otto Group Product Classification Challenge, beating the original winning score of 0.382 achieved by Gilberto Titericz and Stanislav Semenov.

media MarkTechPost · 8d ago · 29 views

Nums AI releases Causilo, a tabular foundation model topping TabArena among single models

Nums AI has released Causilo, a pretrained tabular foundation model for classification and regression that achieves the highest Elo score among single models on TabArena. The model utilizes an in-context learning approach where training rows are stored as context rather than updating weights, and it is available with Apache-2.0 code and pretrained weights on Hugging Face.

arxiv arXiv cs.CL · 9d ago Codeforces (Elo) · 98.2% · 30 views

Stellar Colosseum harnesses multi-agent inference for long-horizon math research

Stellar Colosseum is a model-agnostic harness designed to allocate inference across long-horizon research in mathematics and theoretical computer science, addressing the unreliability of language models on complex problems. The system explores alternative strategies before proof construction, uses a readiness gate to determine when a route is mature enough for decomposition, and represents the proof plan as interdependent section-level subproblems.

arxiv arXiv cs.LG · 9d ago Codeforces (Elo) · 98.2% · 26 views

Stellar Colosseum: many-agent harness for long-horizon math and TCS research

The authors introduce Stellar Colosseum, a model-agnostic harness designed to allocate inference across long-horizon research in mathematics and theoretical computer science. The system explores alternative strategies before proof construction, uses a readiness gate to determine when a route is mature enough for decomposition, and represents the proof plan as interdependent section-level subproblems.