media r/LocalLLaMA · 1h ago · open_models

NVIDIA AVO achieves 100% on ARC-AGI-3

from English

NVIDIA's AVO model has achieved a perfect score on the ARC-AGI-3 benchmark. It successfully completed all 183 levels across 25 public environments without any instructions, explicit rules, or stated goals.

NVIDIA AVO scored 100% on ARC-AGI-3.
The model solved all 183 levels in 25 public environments.
It operated without instructions, explicit rules, or stated goals.

Importance 2/3 r/LocalLLaMA NVIDIA Benchmark results Reasoning models

Read original

lab NVIDIA Technical Blog · 38d ago · 23 views

NVIDIA analyzes 5,000+ Kaggle entries to identify techniques for improving AI reasoning

The NVIDIA Nemotron Model Reasoning Challenge invited the Kaggle community to explore techniques that improve reasoning accuracy under shared constraints of open models, benchmarks, and infrastructure. By the close of the competition, more than 5,000 active participants across 4,000 teams had generated thousands of submissions.

lab NVIDIA · 260d ago · 57 views

NVIDIA researchers win Kaggle ARC Prize 2025 with cost-efficient AGI reasoning

NVIDIA researchers Ivan Sorokin and Jean-Francois Puget won the Kaggle ARC Prize 2025, achieving first place on the public leaderboard with a 27.64% score on the ARC-AGI-2 benchmark. Their solution, named NVARC, utilized a fine-tuned 4B model variant that outperformed larger models at just 20 cents per task.

lab NVIDIA Technical Blog · 1h ago Live

NVIDIA AVO reaches 100% on ARC-AGI-3 benchmark

NVIDIA has released its AVO architecture, which achieves a perfect score on the ARC-AGI-3 benchmark. The system is designed to support long-horizon autonomous agents by managing context, tool usage, and state recovery.

arxiv arXiv cs.LG · 63d ago · 6 views

Probe-and-Refine Tuning Improves Coding Agent Performance

A new method called probe-and-refine tuning uses synthetic bug-fix probes to iteratively improve repository guidance files with single-shot LLM calls, without agent loops or tool use. On SWE-bench Verified, it achieves a 33.0% mean resolve rate—14.5 percentage points higher than the initial static knowledge base—showing improved coverage rather than patch precision. The method enables agents to use larger step budgets effectively, and performance remains stable across models when diagnostic output is sufficient.

arxiv arXiv cs.AI · 63d ago · 4 views

QMFOL: Benchmarking LLM Reasoning with Controllable Logical Complexity

QMFOL is an automated framework that generates monadic first-order logic reasoning tasks with quantifiable complexity. It produces 2880 benchmark instances across 960 configurations, evaluating six large reasoning models and two LLMs, showing performance degradation and increased computational cost as logical complexity rises.