Topic · Research paper
arxiv arXiv cs.LG · 12d ago · 2 views

Moonshot AI releases Kimi K3, a 2.8T parameter MoE model with million-token context

Moonshot AI has introduced Kimi K3, an open-source Mixture-of-Experts model featuring 2.8 trillion total parameters and 104 billion activated parameters per token. The model supports native vision capabilities and a 1-million-token context window, leveraging Kimi Delta Attention and Stable LatentMoE to achieve approximately 2.5x scaling efficiency over its predecessor, Kimi K2.

arxiv arXiv cs.LG · 5d ago OSWorld 2.0 · 21.2% · 6 views

Qwen releases Qwen-CUA, a 397B-A17B native computer-use agent

Qwen introduces Qwen-CUA, a native computer-use agent built on a 397B-A17B mixture-of-experts backbone that operates via screenshots and input events without relying on DOM trees or accessibility metadata. The system utilizes a scaffold to maintain up to 20 active screenshots and was trained using a cloud rollout fleet with nearly 100,000 vCPUs across approximately 40,000 verifiable tasks.