github llama.cpp · 1h ago · inference

llama.cpp b10259 allows tensor reshape during load

from English

The llama.cpp project has released build b10259, which introduces the ability to allow the reshape of tensors during the loading process.

This update includes binaries for macOS (Apple Silicon and Intel), Linux (Ubuntu with CPU, Vulkan, ROCm, OpenVINO, and SYCL backends), Android, Windows (CPU, CUDA 12/13, Vulkan, OpenCL, HIP, OpenVINO, and SYCL), and openEuler.

The release also provides the standalone UI package for users.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency Local inference

Read original

github llama.cpp · 7h ago

llama.cpp b10254 adds DeepSeek V4 Flash 0731 template and updates V4 templates

The llama.cpp project released version b10254, introducing a new chat template for the DeepSeek V4 Flash 0731 model alongside updates to existing DeepSeek V4 templates.

github llama.cpp · 10h ago

llama.cpp b10251 adds MTP support for GLM-4.7-Flash

The llama.cpp project has released build b10251, which introduces Multi-Token Prediction (MTP) support for the GLM-4.7-Flash model.

github llama.cpp · 1d ago

llama.cpp b10238 adds MTP support for Qwen3-Next

The llama.cpp project released build b10238, which introduces Multi-Token Prediction (MTP) support for the Qwen3-Next model family. This update includes specific implementation changes to handle MTP layers and fixes related to Python type checking within the codebase.

github llama.cpp · 1d ago · 5 views

llama.cpp b10237 adds MTP support for DeepSeek V3.2

The llama.cpp project released build b10237, which introduces Multi-Token Prediction (MTP) support for the DeepSeek V3.2 model.

github llama.cpp · 2d ago · 7 views

llama.cpp b10232 implements DeepSeek V4 hyper-connections in Metal

The llama.cpp project released build b10232, which introduces support for DeepSeek V4 hyper-connections via the Metal backend. This update adds implementation of GGML_OP_DSV4_HC_COMB, GGML_OP_DSV4_HC_PRE, and GGML_OP_DSV4_HC_POST operations.