Spotlight enables DiT RL post-training by leveraging idle spot GPUs, reducing costs by 1.4-6.4× while achieving superior image quality. It uses stale model weights in exploration and reconfigures sequence parallelism in real time, allowing efficient GPU utilization without breaking training pipelines.
arxiv
arXiv cs.AI
·
60d ago
·
research
Spotlight: Using Spot GPUs to Accelerate DiT RL Post-Training
from English
Importance 3/3
New feature vs. leaders
New harness with differentiators
arXiv cs.AI
Alibaba (Qwen)
DeepSeek
Microsoft Research
AI agents
Evaluation & benchmarks
Training methods
Related articles
arxiv
arXiv cs.LG
·
60d ago
Spotlight: Using Spot GPUs to Accelerate DiT RL Post-Training
Spotlight enables DiT RL post-training by leveraging idle spot GPUs, reducing costs by 1.4-6.4x while achieving superior image quality. It uses stale model weights in exploration and reconfigures sequence parallelism on-the-fly, allowing efficient GPU utilization without breaking training pipelines.
arxiv
arXiv cs.LG
·
61d ago
ATT&CK-Labeled Multi-Source Cybersecurity Logs Dataset Released
A new dataset combines system, network, and browser logs from 870 Windows sessions, including 70 attacks and 800 benign cases. It provides per-event labels with MITRE ATT&CK technique IDs for 12 tactics and 53 techniques, using real attack tools like RAT and C2 tunnels. Fine-tuning three Small Language Models (SLMs) via LoRA improved chunk classification accuracy to 90–97% and achieved up to 42% exact-match accuracy in technique identification, showing strong reasoning capture despite challenges.
arxiv
arXiv cs.CL
·
61d ago
OPD-Evolver: On-Policy Distillation for Holistic Agent Evolving
OPD-Evolver introduces a slow-fast co-evolution framework that enables agents to select, act on, and reuse experience through on-policy self-distillation. It outperforms existing memory and training-based methods by up to 11.5% and 5.8% respectively, and demonstrates capability to challenge large-scale models like Qwen3.5-397B-A17B and Step-3.5-Flash.
media
r/LocalLLaMA
·
62d ago
Be wary of Qwen/Claude distillations - they're often worse than the base model
Distillations of Qwen and Claude models, such as Qwen 3.6 distilled with only 4,000 samples, rarely improve performance and often degrade quality. These models may exhibit a more 'Opus-like' style but fail to transfer actual capability, with some showing hallucinations and slower response times compared to the base models, as demonstrated in testing and user reports.
arxiv
arXiv cs.CL
·
1h ago
·
1 view
Live
SocialRL trains 4B model to match GPT-5 in negotiation via social reasoning
Researchers present SocialRL, a training recipe that directly reinforces social reasoning in small language models to improve their performance as strategic negotiators. Applied to a 4B model across six domains including Deal-or-No-Deal and Job Interview, the approach enables the model to match or exceed GPT-5 family performance on held-out scenarios.