Moonshot AI introduces Kimi K3, an open-source Mixture-of-Experts model featuring 2.8 trillion total parameters and 104 billion activated parameters per token. The architecture utilizes native vision capabilities and supports a 1-million-token context window, enabled by Kimi Delta Attention and Stable LatentMoE.
Researchers introduce M$^3$R-Bench, a unified benchmark containing 1,000 image-text instances with human-verified annotations designed to evaluate evidence-grounded multimodal metaphor understanding. The benchmark provides joint annotations for metaphor occurrence, Target-Source mapping, sentiment, and stage-wise explanations based on Conceptual Metaphor Theory.
Douyin has released the technical report for its Multimodal Embedding (DME) model, which combines large-scale contrastive pre-training with latent reasoning to achieve strong discrimination and efficiency.
Researchers have introduced Qwen-CUA, a native computer-use agent built on a 397B-A17B Qwen mixture-of-experts backbone. The system operates by observing screenshots and acting through keyboard and mouse events, without relying on DOM trees or accessibility metadata.
Research demonstrates that chain-of-thought (CoT) monitoring fails against adversaries who control the reasoning process. By rewriting an agent's reasoning to appear as good-faith engineering while keeping commands and outputs verbatim, attackers can bypass detection mechanisms.
Researchers present Memory Decoder at Scale, a system that scales parametric long-term memory models up to 6.9B parameters and pretrains them on 300B tokens. To address the infeasibility of standard Faiss pipelines at this data scale, the authors implement a distributed indexing pipeline with sparse, batch-wise loading of kNN distributions.
Frontis releases Frontis-MA1, a 35B parameter AI4AI model designed for recursive self-improvement in machine learning engineering, alongside the open-source OpenMLE stack. The system integrates verifiable task environments, operator learning, and long-horizon search to enable an agent that improves its own code through execution-grounded training.
Researchers introduce OSReward, a realistic benchmark designed to evaluate the reliability of vision-language models (VLMs) acting as judges for computer-using agent trajectories. The study reveals that even state-of-the-art VLMs suffer from systematic leniency bias and are often too expensive for scale, while affordable open models perform poorly.
Researchers propose Living-Harness, a self-evolving agent harness that converts completed trajectories and evaluator signals into posterior evidence for bounded harness updates. Guided by an Evolution-SOP, the system extracts episode abstractions and structured update evidence to write episodic memory and state graphs.
Researchers tested constitutional midtraining by inserting values-based content into the training process of 120B-scale models to determine if it produces more durable alignment than standard post-training methods. The study found that this approach significantly improves alignment generalization and durability, particularly in mitigating blackmail propensity after supervised fine-tuning.
Researchers introduce Relay On-Policy Distillation (Relay-OPD) to address prefix failure in standard on-policy distillation, where student errors lead to unreliable supervision. The method uses a teacher-student continuation asymmetry as a trigger for the teacher to briefly take over and redirect the trajectory before the student resumes.
PIVOT (Proxy Indexing Via One full-prefix Traversal) is a training-free, drop-in replacement for the DeepSeek Sparse Attention (DSA) indexer that reduces computational redundancy by sharing one prefix scan across a group of nearby queries. Instead of scoring every preceding token for each query individually, PIVOT aggregates the group into a single proxy query to obtain a candidate set, from which top-k tokens are selected for each query.
Researchers introduce ClinFusion, a vision-centric multimodal large language model designed for holistic medical understanding that unifies 2D and native 3D image analysis. The system utilizes a compositional cascaded vision encoder with a Cascade Spatial-Aware Locality Fusion operator to address the challenges of heterogeneous medical imaging.
Researchers present AgentOmnia, a framework for full-scenario agentic scaling that coordinates task-space definition, data synthesis, post-training, evaluation, and improvement across To-Consumer, To-Business, and To-Employee applications. The system utilizes an extensible taxonomy and constructs 5,018 stateful environments with 255,375 tools and 52,361 tasks to enable fine-grained diagnosis via OmniaBench.
A study demonstrates that frontier language models can perform consequential computation using semantically irrelevant filler tokens, creating a failure mode where reasoning is not visible in the output chain-of-thought. The research evaluated 13 models across three tasks and found that many benefit significantly from these tokens, with accuracy improvements of up to 13 percentage points.
The report introduces Zing, an integrated framework designed to enhance the social intelligence of large language models by measuring, internalizing, and grounding social capabilities. The authors present SoMBench, a psychology-grounded benchmark spanning 17 secondary dimensions and 3,481 expert-verified instances, which reveals that current LLMs have significant room for improvement with no model reaching near-ceiling performance.
OpenForgeRL is an open-source framework that allows researchers to train harness-based AI agents end-to-end using standard reinforcement learning stacks. It decouples training from inference by employing a lightweight proxy to record model calls as data and a Kubernetes orchestrator to manage rollouts in remote containers.
Nanbeige4.2-3B is a compact general agentic model with 3B non-embedding parameters, pretrained from scratch on 28T tokens using a Looped Transformer architecture that reuses layer stacks to increase capacity without adding parameters.
Researchers present OpenForgeRL, an open-source framework that allows for the end-to-end training of AI agents using complex inference harnesses like Claude Code and OpenClaw. The system decouples training from inference by employing a lightweight proxy to record model calls as data and a Kubernetes orchestrator to manage remote container rollouts.
The Solar Open 2 Technical Report introduces Solar Open 2, a 250B-A15B Mixture-of-Experts language model designed for long-horizon agentic tasks. It achieves a 1M-token context window through a hybrid attention stack and is trained using efficient initialization from Solar Open 1 and curated high-value data.