arxiv Moonshot AI (arXiv) · 794d ago

DeepSeek releases DeepSeek-Coder-V2, an open-source MoE model matching GPT-4 Turbo in code tasks

from English

DeepSeek has released DeepSeek-Coder-V2, an open-source Mixture-of-Experts (MoE) code language model that achieves performance comparable to GPT-4 Turbo in code-specific tasks. The model is further pre-trained from an intermediate checkpoint of DeepSeek-V2 using an additional 6 trillion tokens.

Enhances coding and mathematical reasoning capabilities while maintaining general language performance.
Expands programming language support from 86 to 338 languages.
Extends context length from 16K to 128K.
Outperforms closed-source models like GPT-4 Turbo, Claude 3 Opus, and Gemini 1.5 Pro in coding and math benchmarks.

This release provides a high-performance open alternative for code intelligence, offering significant advancements over its predecessor DeepSeek-Coder-33B.

Importance 2/3 Moonshot AI (arXiv) DeepSeek Code generation Open weights

Read original

media r/LocalLLaMA · 2h ago

AntLing open-sources 6 Ling-3.0 base model checkpoints for continued pre-training

AntLing has released six base model checkpoints for its Ling-3.0-tiny and Ling-3.0-flash architectures, covering pre-trained, mid-trained, and WSM-merged stages. These models have not undergone post-training, providing researchers with flexible starting points for continued pre-training, fine-tuning, and further research.

blog Simon Willison · 51d ago · 2 views

Ornith-1.0: Self-Scaffolding LLMs for Agentic Coding

DeepReinforce has released Ornith-1.0, an open-weight model licensed under MIT that achieves state-of-the-art performance among open-source models of comparable size on coding benchmarks. The model is built upon pretrained Gemma 4 and Qwen 3.5 foundations and includes variants with 9B Dense, 31B Dense, 35B MoE, and 397B MoE parameter counts.

media r/LocalLLaMA · 61d ago · 11 views

The economics of AI are starting to favor open models

Recent AI model releases show that high-intelligence, low-cost models are increasingly dominated by open-weight models like DeepSeek, Qwen, GLM, Kimi, and MiniMax. For most real-world applications, the performance gap between frontier closed models and strong open models is shrinking faster than cost differences, making open models competitive in terms of both capability and price.

media r/LocalLLaMA · 4h ago

Ornith-1.5 releases 9B, 35B-A3B, and 397B models with self-improving training

Ornith-1.5 is a new family of open-source large language models comprising 9B Dense, 35B MoE, and 397B MoE variants trained using self-improving strategies. The models achieve state-of-the-art performance among open-source models of comparable size and deliver results comparable to Claude Opus 4.8 across reasoning, agentic, and coding tasks.

media Together AI Blog · 2d ago · 17 views

DeepSeek V4 Pro 0813 vs Claude Fable 5 on DeepSWE: Cost, Coding, and Routing

A comparison of DeepSeek V4 Pro 0813 and Claude Fable 5 on the DeepSWE benchmark reveals that a routing strategy using both models solves 82.7% of tasks at $8.28 each, outperforming Fable alone (69.7%) while being significantly cheaper.