github llama.cpp · 1d ago · inference

llama.cpp b11024 updates OpenVINO to 2026.4 and fixes warnings

from English

The llama.cpp project released build b11024, which primarily updates the OpenVINO integration to version 2026.4.

Updates ggml-openvino to use OpenVINO 2026.4.
Fixes clangd and MSVC warnings in the OpenVINO backend.
Resolves int-to-pointer cast issues, enforces internal linkage, and avoids duplicate switch cases.
Provides binaries for macOS (Apple Silicon and Intel), Linux (CPU, Vulkan, CUDA, ROCm, SYCL), Windows (CPU, Vulkan, CUDA, OpenCL, ROCm, SYCL), Android, and openEuler.

This release ensures compatibility with the latest OpenVINO toolkit while addressing compiler warnings and internal code consistency issues.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency Local inference

Read original

github llama.cpp · just now · 1 view Live

llama.cpp b11046 adds OpenCL support for flash_attn_f32_f16_bin kernel

The llama.cpp project released version b11046, which introduces OpenCL support for the `flash_attn_f32_f16_bin` kernel. This update also includes guarded prefill functionality for Flash Attention on OpenCL devices.

github llama.cpp · 5h ago · 1 view

llama.cpp b11042 adds OpenCL A8 Q6_K binary kernel

The llama.cpp project has released version b11042, which introduces a new OpenCL binary kernel for A8 Q6_K non-MoE models. This update also includes fixes for layout compatibility within the OpenCL backend.

github llama.cpp · 9h ago · 1 view

llama.cpp b11039 adds SWA pattern support to model-saver and loaders

The llama.cpp project released build b11039, which updates the model-saver to write sliding window attention (SWA) patterns and MLA SWA geometry for all models using SWA. The change ensures that the `sliding_window_pattern` is written as a per-layer flag rather than being collapsed to a scalar, preserving exact data representation.

github llama.cpp · 1d ago · 2 views

llama.cpp b11025 extends Nemotron MTP support

The llama.cpp project has released build b11025, which includes an extension of Nemotron Multi-Token Prediction (MTP) support.

github llama.cpp · 2d ago · 4 views

llama.cpp b11019 fixes GGUF data alignment for embedded files and adds LoRA loading

The llama.cpp project released version b11019, addressing a critical bug where GGUF files embedded at non-aligned offsets returned incorrect tensor data. The update aligns the GGUF data section relative to the file start rather than offset 0, ensuring correct loading of embedded models.