lab Mistral AI · 392d ago

Mistral AI releases Devstral Small 1.1 and Devstral Medium with All Hands AI

from English

Mistral AI, in collaboration with All Hands AI, has released Devstral Small 1.1 and the new Devstral Medium models to enhance agentic coding capabilities.

Devstral Small 1.1 achieves a state-of-the-art score of 53.6% on SWE-Bench Verified among open models without test-time scaling.
The model supports both Mistral function calling and XML formats for better generalization across different prompts and agentic scaffolds.
Devstral Medium scores 61.6% on SWE-Bench Verified, surpassing Gemini 2.5 Pro and GPT 4.1 at a quarter of the price.
Devstral Small 1.1 is open-sourced under the Apache 2.0 license, while Devstral Medium is available via API and for enterprise deployment.

These releases provide developers with cost-effective, high-performance options for autonomous software development and agentic tasks.

Importance 2/3 Beats a top-lab benchmark Mistral AI Mistral AI Code generation Open weights

Benchmarks

Benchmark	Model	Score
SWE-bench Verified	Devstral Medium	61.6%
SWE-bench Verified	Devstral Small 1.1	53.6%

Read original

media r/LocalLLaMA · 33d ago · 3 views

Mistral released Leanstral-1.5-119B-A6B

Mistral has released Leanstral 1.5, a free Apache-2.0 licensed model with 6B active parameters designed for formal verification and automated theorem proving.

media r/LocalLLaMA · 44d ago

Gemma 4's Potential to Outperform Mistral and Qwen3.6 Through Finetuning

Gemma 4 shows strong base performance and unique features like global MTP support, QAT, and out-of-the-box vision capabilities. While it currently lacks widespread finetunes, models like MeroMero, Equinox, and Gembrain have already demonstrated high quality, suggesting that with community effort, Gemma 4 could surpass Mistral or Qwen3.6 in specific tasks like coding and creative writing.

media r/LocalLLaMA · 45d ago · 4 views

GLM-5.2 Beats Gemini and GPT-5.4 in Coding but Is Inefficient

GLM-5.2 surpasses GPT-5.4 and the entire Gemini lineup in coding performance on the DeepSWE benchmark. However, it requires significantly more output tokens, making it substantially less efficient in terms of cost-per-task compared to models like GPT-5.5 and Claude Opus 4.8.

media r/LocalLLaMA · 46d ago · 3 views

What happens when LLM subscriptions stop being subsidized?

LLM providers currently subsidize expensive API usage to build ecosystems, planning to raise prices later. As subsidies dwindle, users may face steep price increases—like $2k per month—making access costly and threatening widespread adoption, especially for individuals relying on affordable hardware to run models.

media r/LocalLLaMA · 49d ago

Local models went from mostly useless to actually useful in one year

Local models transitioned from being primarily privacy-focused toys to practical tools for coding, private document management, and local workflows within a year. While they still fall short of replacing top closed models for complex tasks requiring planning and error correction, the overall improvement in usability and performance is evident.