Moonshot AI has introduced Kimi K3, an open-source Mixture-of-Experts model featuring 2.8 trillion total parameters and 104 billion activated parameters per token. The model supports native vision capabilities and a 1-million-token context window, leveraging Kimi Delta Attention and Stable LatentMoE to achieve approximately 2.5x scaling efficiency over its predecessor, Kimi K2.
Researchers propose Unsupervised On-Policy Self-Distillation (U-OPSD), a method that achieves post-training improvement for large language models using only the model's own generations without external supervision. The approach samples multiple rollouts to construct a pseudo-solution via majority vote, then distills a teacher distribution into prefixes of the model's longest incorrect completion.
Qwen introduces Qwen-CUA, a native computer-use agent built on a 397B-A17B mixture-of-experts backbone that operates via screenshots and input events without relying on DOM trees or accessibility metadata. The system utilizes a scaffold to maintain up to 20 active screenshots and was trained using a cloud rollout fleet with nearly 100,000 vCPUs across approximately 40,000 verifiable tasks.
Researchers introduce SkewAdam, an optimizer designed for mixture-of-experts (MoE) models that allocates different state types to distinct parameter populations to drastically reduce memory usage. By assigning float32 momentum and factored second moments to the backbone, factored second moments to experts, and exact second moments to the router, SkewAdam reduces optimizer state from 50.6 GB to 1.29 GB for a 6.78B-parameter model.
Researchers introduce RoboTTT, a training recipe that extends visuomotor context for robot foundation models to 8,000 timesteps without increasing inference latency. The method integrates Test-Time Training into Vision-Language-Action policies by using fast weights updated via gradient descent during both training and inference.
The authors propose TRACE (Turn-level Reward Assignment via Credit Estimation), a dense credit-assignment method for agentic reinforcement learning that addresses the sparsity and high variance of outcome rewards in long-horizon tasks. By representing rollouts as state transitions at tool-call boundaries and deriving per-action rewards from log-ratio state values, TRACE enables effective training without additional critics or supervised fine-tuning stages.
Researchers present TerraZero, a procedural driving simulator and self-play training stack designed for training robust autonomous driving agents without human demonstrations. The system utilizes a configurable C engine to run simulation on the CPU and policy inference on the GPU over a zero-copy path, sustaining 1.3M agent-steps per second on a single server-grade GPU.
The authors present REGRIND, a minimalist retargeting-guided reinforcement learning pipeline that learns dexterous manipulation policies from a single human demonstration. The method retargets human hand-object motion to robot references while preserving spatial and contact relationships, then trains a residual RL policy in simulation to track object-centric keypoints.
The Mach-Mind-4-Flash technical report introduces a 35B-parameter Mixture-of-Experts (MoE) agentic model with only 3B activated parameters. Through post-training optimization alone, the model achieves performance on par with or surpassing 100B-parameter-class models without scaling pre-training compute.
Deutsche Telekom has released Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts hybrid Mamba Transformer foundation model designed for German and English. Built end-to-end on the German Industrial AI Cloud, the model activates only 3 billion of its 30 billion parameters per token to maintain near-constant inference cache as context grows.
Researchers have improved the convergence bound for the Dikin walk, a method for sampling uniformly from polytopes inspired by interior-point methods. The new proof demonstrates that using a scaled Lee-Sidford metric reduces the mixing time from $d^{2.5}$ to $d^{2.25}$ iterations.
The authors extend the empirical Bayes variational autoencoder (EB-VAE) framework to jointly model longitudinal tumor measurements and time-to-event dropout data. The approach uses a covariate-conditioned prior to represent inter-individual variability and augments the decoder with a hazard model to account for informative dropout.
The authors propose using the Lyapunov characteristic exponent (LCE) as a dense reward signal for stabilizing an inverted pendulum with vertical motion. This approach enables reinforcement learning agents to discover complex stabilization behaviors beyond standard oscillatory solutions.
Researchers introduce Lighthouse RL, a reinforcement learning approach that improves sample efficiency in analog circuit sizing by using high-performing configurations as strategic reset points.
A study evaluates whether agent-optimization gains compound over time by testing three methods—GEPA, Meta Harness, and RELAI-VCL—on the hard tasks of Terminal-Bench 2.0. While all methods improve upon a static baseline, only RELAI-VCL successfully transfers to unseen tasks and continues improving after subsequent optimization rounds.
The article investigates how components of the Transformer feedforward block architecture determine the amount of rank that survives across depth at initialization. It reinterprets skip connections and normalization as mechanisms for preserving gradient rank, which is otherwise reduced by matrix multiplications and nonlinear activations.
Researchers propose Cluster-based Sequential Feature Selection (CSFS), a novel clustering-based wrapper method for automatic and efficient feature selection in renewable energy prediction pipelines. The approach addresses the lack of systematic methods for selecting input features from the large number of available monitoring and environmental variables.
A recent analysis of 25,264 agentic pull requests across 2,361 popular GitHub repositories reveals that intensive adoption of agentic coding tools remains limited to a small subset of open-source projects. The study indicates that the median repository generates only one to two such PRs over a three-month period.
The article presents a multi-expert system for historical Manchu OCR that handles visually distinct writing styles like regular script, running script, and semi-cursive chancery hand despite limited labeled data. The approach reuses checkpoints from an iterative fine-tuning process as domain specialists and employs a lightweight page-level image classifier to dispatch pages based on visual style.
Researchers evaluated the biosecurity potential of genomic foundation models by training linear and attention probes on frozen Evo 2 layer-26 activations to screen for antimicrobial resistance (AMR) in metagenomic data. The study found that these lightweight probes can detect AMR with strong discrimination, achieving a region-level ROC-AUC of 0.977 using a single-head attention probe.