The podcast reviews the evolution of post-training recipes in large language models, from InstructGPT to 2026 frontier models. It highlights Multi-Teacher On-Policy Distillation (MOPD) as the dominant pattern, where domain-specialist models are trained and then distilled into a general student model via on-policy distillation, scaling to over 10 teachers in models like DeepSeek V4 and Nemotron 3 Ultra.
media
Interconnects
·
54d ago
·
post_training
Frontier Post-Training Recipe Review with Finbarr Timbers
from English
Importance 2/3
New harness with differentiators
Interconnects
Allen AI
DeepSeek
Mistral AI
AI agents
Reasoning models
Training methods
Related articles
arxiv
arXiv cs.AI
·
51d ago
RACL: Reasoning-Agent Control Layer for Metaheuristic Learning
RACL introduces a reasoning agent that controls metaheuristic search behavior without replacing optimizers or altering constraints. It improves or ties key policies in vehicle routing experiments, reducing average cost by 8.337% versus Fixed and 1.605% versus Stagnation-Triggered policies, with no significant computational overhead.
arxiv
arXiv cs.LG
·
51d ago
·
2 views
Training LLMs for Long-Lifecycle Agents via Cross-Domain Generalization
A new framework enables large language models to develop 'Connect the Dots' capability, allowing long-lifecycle agents to learn from experiences and iteratively update their environment context. The framework uses reinforcement learning with long rollout sequences and custom tasks to promote cross-domain generalization, showing effective out-of-distribution performance in both domains and transition settings.
arxiv
arXiv cs.CL
·
51d ago
·
1 view
Training LLMs for Long-Lifecycle Agents via Cross-Domain Generalization
A new framework enables large language models to learn 'Connect the Dots' by using reinforcement learning with long rollout sequences. The method includes tailored tasks and environments to foster meta-capability development, showing strong cross-domain generalization and performance in out-of-distribution settings. Implementations are available at https://github.com/agentscope-ai/Trinity-RFT/tree/research/cod/examples/research_cod.
arxiv
arXiv cs.AI
·
52d ago
·
1 view
X+Slides: Benchmark for Audience-Conditioned Slide Generation
X+Slides introduces a benchmark that evaluates slide generation based on target audience needs. It uses 8,133 source-grounded probes across 113 topics and seven scenes to measure Audience Coverage, Domain-wise Coverage, Efficiency, and Correctness, revealing that current systems recover only partial audience-essential information, with DeepPresenter achieving 0.714 Audience Coverage, SlideTailor 0.594, and NotebookLM ablation 0.853, highlighting the need for source-grounded evaluation.
arxiv
arXiv cs.AI
·
52d ago
·
1 view
Reinforcement Learning Foundation Models Should Already Be A Thing
Reinforcement learning lacks foundation models despite synthetic MDPs being feasible. A proof-of-concept shows a single model trained on synthetic MDPs solves tabular benchmarks without tuning, outperforming existing methods in online settings and matching them offline.