lab Mistral AI · 445d ago

Mistral AI releases Devstral agentic LLM for software engineering

from English

Mistral AI and All Hands AI have released Devstral, an agentic large language model designed for real-world software engineering tasks. The model is trained to solve actual GitHub issues by running over code agent scaffolds like OpenHands or SWE-Agent.

Devstral achieves a score of 46.8% on the SWE-Bench Verified benchmark, outperforming prior open-source state-of-the-art models by more than 6 percentage points.
It exceeds the performance of larger models such as Deepseek-V3-0324 (671B) and Qwen3 232B-A22B when evaluated under the same test scaffold.
The model surpasses closed-source alternatives like GPT-4.1-mini by over 20% on the benchmark.
Devstral is lightweight enough to run locally on a single RTX 4090 or a Mac with 32GB RAM, and is available under the Apache 2.0 license.

The release aims to provide a tool for local deployment, enterprise use in privacy-sensitive environments, and integration into agentic coding IDEs.

Importance 2/3 Mistral AI Mistral AI AI agents Code generation

Benchmarks

Benchmark	Model	Score
SWE-bench Verified	Devstral	46.8%

Read original

arxiv arXiv cs.AI · 51d ago · 3 views

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

AutoPass uses runtime and compiler evidence to guide LLM-generated optimization decisions, outperforming expert heuristics and classical autotuning methods. It achieves geometric-mean speedups of 1.043x on x86-64 and 1.117x on ARM64 systems without prior training or fine-tuning.

arxiv arXiv cs.CL · 51d ago · 1 view

AgentFinVQA: Auditable, On-Premise Financial Chart QA

AgentFinVQA introduces a multi-agent pipeline for financial chart question answering that ensures auditability and on-premise deployability without significant accuracy loss. It outperforms baseline models by +7.68 pp using a proprietary backbone and +4.84 pp with open-weights Qwen3.6-27B-FP8, while providing a confidence signal via verifier output that improves human review routing.

arxiv arXiv cs.AI · 52d ago

LLM-as-Interface, ML-as-Predictor for Pediatric Appendicitis

ClaMPAPP, a hybrid system, uses an LLM to extract structured clinical features from free-text notes and passes them to an XGBoost classifier for diagnosis. It outperformed end-to-end LLMs in both internal and external validation, with better diagnostic performance and fewer missed cases, demonstrating superior stability and safety in pediatric appendicitis triage.

arxiv arXiv cs.CL · 52d ago · 1 view

HandwritingAgent: Language-Driven Handwriting Synthesis in SVG

HandwritingAgent synthesizes natural handwriting in SVG format without style-specific training. It uses a large reasoning model to generate stroke sequences in a grid canvas, conditioned on text input and a reference style image, enabling efficient, controllable, and generalizable handwriting generation.

media r/LocalLLaMA · 53d ago

Headless screenshot loops enable a 30B local agent to debug raytraced FPS in pure C

A local 30B agent, using headless screenshot loops, autonomously debugs a raytraced FPS demo in pure C by capturing frames at key events and iterating on fixes. The agent builds a recursive visual debugging loop, demonstrating that simple feedback mechanisms can enable small models to solve complex, visually grounded tasks.