media r/LocalLLaMA · 1h ago · open_models

SLAI T-Rex achieves 34.22% MFU and 71.81% Pass@1 for DeepSeek-V4 on Ascend

from English

SLAI introduces T-Rex, a full-parameter post-training framework for the DeepSeek-V4 model family on Ascend SuperPOD infrastructure. The system addresses memory pressure and communication overhead in trillion-parameter MoE models through hierarchical optimization.

Achieves 34.22% Model FLOPs Utilization (MFU), a 2.93x improvement over the open-source baseline.
Establishes a CPT and SFT workflow for Operations Research tasks using solver-verified synthetic data.
The specialized DeepSeek-V4-Flash model reaches a 71.81% zero-shot Pass@1 score, outperforming GPT-5.4-Mini by 3.98 percentage points.

This work demonstrates an efficient pathway for post-training frontier models on Ascend hardware and creating domain-specialized capabilities for complex reasoning.

Importance 2/3 r/LocalLLaMA Research paper Training methods

Read original

arxiv arXiv cs.LG · 7d ago

Lyapunov Exponent as Physics-Informed Dense Reward: RL Discovery of Stabilization Beyond the Kapitza Pendulum

The authors propose using the Lyapunov characteristic exponent (LCE) as a dense reward signal for stabilizing an inverted pendulum with vertical motion. This approach enables reinforcement learning agents to discover complex stabilization behaviors beyond standard oscillatory solutions.

arxiv arXiv cs.LG · 7d ago

Lighthouse RL introduces strategic reset points for sample-efficient analog circuit sizing

Researchers introduce Lighthouse RL, a reinforcement learning approach that improves sample efficiency in analog circuit sizing by using high-performing configurations as strategic reset points.

arxiv arXiv cs.CL · 7d ago

Meta-learning framework enables multilingual LLM alignment with minimal preference data

Researchers propose a meta-learning framework for Reinforcement Learning from Human Feedback and Direct Preference Optimization to address the challenge of unequal human preference data availability across languages. By leveraging preference data from other languages, the method learns a transferable initialization that allows effective adaptation to a target language using very few samples.

arxiv arXiv cs.CL · 7d ago

Study analyzes optimal RL post-training compute allocation across model size, search, and feedback

A study investigates the fixed-budget decision problem of allocating Reinforcement Learning (RL) post-training resources, specifically examining whether to prioritize larger policies, extended training, more rollout search, or stronger reward feedback.

arxiv arXiv cs.CL · 7d ago

Study finds on-policy distillation success depends on signal quality, not teacher scale

A systematic study of on-policy distillation (OPD) identifies it as an exploration catalyst that steers students via dense token-level guidance without expanding the capability ceiling. The research confirms that OPD effectiveness relies entirely on guiding signal quality rather than prompt diversity or per-problem sampling numbers.