arxiv arXiv cs.LG · 1h ago · research

Faraday 27B outperforms Claude Opus 4.8 and GPT-5.5 on paper replication tasks

from English

Researchers have developed Replica, a scalable task space for paper replication, to address the need for reliable scientific knowledge. They post-trained Faraday, a 27B-parameter "AI Scientist" agent that uses coding agents as tools, to leverage this environment.

Replica provides an auto-generated rubric-based judge with low noise that aligns with human assessment of replication quality.
Faraday surpasses the performance of Claude Opus 4.8 and GPT-5.5 on held-out replication tasks.
Qualitative analysis shows Faraday adopts a more scientifically-principled approach compared to other models.

The results serve as a stepping stone towards AI agents capable of long-horizon scientific innovation without requiring complex harnesses.

Importance 2/3 New harness with differentiators arXiv cs.LG DeepSeek AI agents Research paper

Read original

arxiv arXiv cs.AI · 2h ago · 1 view

Faraday 27B surpasses Claude Opus 4.8 and GPT-5.5 on paper replication tasks

Researchers have developed Replica, a scalable task space for paper replication, and introduced an auto-generated rubric-based judge to provide low-noise reward signals that align with human assessment.

arxiv arXiv cs.CL · 40d ago

AutoMem automates learning of memory as a cognitive skill for LLMs

Researchers introduce AutoMem, a framework that treats memory management in large language models as a trainable skill rather than a static component. The system promotes file-system operations to first-class memory actions, allowing the model to autonomously decide how to encode, retrieve, and organize knowledge.

arxiv arXiv cs.CL · 45d ago

Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent

Researchers introduce Agents-A1, a 35B Mixture-of-Experts model that achieves performance comparable to trillion-parameter models by scaling the agent horizon rather than parameter count. The approach focuses on extending long-horizon trajectories and unifying heterogeneous agent abilities through a specialized training infrastructure.

arxiv Moonshot AI (arXiv) · 255d ago · 2 views

DeepSeek-V3.2 introduces Sparse Attention and agentic synthesis, surpassing GPT-5

DeepSeek has released DeepSeek-V3.2, an open large language model that combines high computational efficiency with advanced reasoning capabilities. The release highlights three main technical advancements: a new sparse attention mechanism, a scalable reinforcement learning framework, and a pipeline for synthesizing agentic training data.

arxiv arXiv cs.AI · 3h ago

AutoDesign uses meta-harness optimization to improve long-horizon agentic design

The paper introduces AutoDesign, a framework that employs a meta-harness optimizer to guide a code agent in recursively improving its harness based on rollout feedback. This approach aims to align with human design priors and accumulate reusable experience for recursive self-improvement.