media Hugging Face Forums · 18h ago · open_models

Agent-ProSAT open-sources programmatic solver coding for CoT synthesis

from English

Shehab Anwer has open-sourced Agent-ProSAT, a pipeline that generates Chain-of-Thought (CoT) datasets by having an agent code and iteratively improve verifiable programmatic solvers rather than relying on model-generated text.

The system uses self-correcting loops to validate logical soundness against ground truth and held-out samples.
It was benchmarked on NVIDIA’s Nemotron Reasoning Challenge using "Alice in Wonderland" logic puzzles to test spatial and logical constraints.
The approach aims to reduce hallucination risks and improve token utilization in SFT/RL pipelines through programmatic review.

The author shares the codebase, a Kaggle notebook for fine-tuning, and the resulting ProSAT CoT dataset on Hugging Face.

Importance 1/3 New harness with differentiators Trust 1/3 Hugging Face Forums AI agents Training methods

Read original

arxiv arXiv cs.AI · 4d ago

AI-accelerated framework validates rapid professional upskilling across five stages

The authors present an end-to-end framework that applies AI acceleration to five stages of knowledge acquisition, content development, review, teaching, and assessment. This approach aims to address the growing enterprise skills gap by improving both production and learning efficiency.

lab NVIDIA Technical Blog · 6d ago · 1 view

NVIDIA NeMo enables autoresearch workflows with RL agent skills

NVIDIA NeMo provides capabilities for coding AI agents to operate long-running machine learning workflows, specifically targeting reinforcement learning research.

media r/LocalLLaMA · 6d ago

Dan Austin RL-trains Qwen3.6-35B-A3B to generate training jobs for smaller Qwen models

Dan Austin has open-sourced a system where an RL-trained Qwen3.6-35B-A3B agent autonomously writes and submits complete training jobs for smaller Qwen models (0.6B or 1.7B). The agent utilizes the prime-rl harness to define environments, rewards, datasets, and hyperparameters, which are then executed on Runpod GPUs.

media r/LocalLLaMA · 6d ago

SAO introduces single-rollout asynchronous optimization for stable agentic RL training

The paper presents Single-rollout Asynchronous Optimization (SAO), a method designed to address stability and off-policy challenges in asynchronous reinforcement learning for large language models. By replacing group-wise sampling with single-rollout sampling, the approach reduces off-policy effects and improves generalization during long-horizon agentic tasks.

arxiv arXiv cs.CL · 6d ago

OpenSquilla introduces Harness-Native agentic routing to create a data flywheel

The article proposes Harness-Native agentic routing, a step-level paradigm that selects models based on the full execution harness state rather than optimizing single-turn cost-quality trade-offs. This approach treats every routing decision as a structured data record to form a harness-native data flywheel, where execution traces train better routers and models.