github llama.cpp · 1h ago · inference

llama.cpp b10215 adds Windows Intel GPU driver version check to fix crashes

from English

The llama.cpp project released build b10215, which introduces a driver version check for Windows Intel GPUs to mitigate crashing issues. This change addresses instability caused by specific driver versions, specifically fixing crashes starting from driver 32.0.101.8860.

Removed the previous crash guard for Intel GPUs and replaced it with a precise driver version check on Windows.
Changed the implementation to convert from `driverVersion` rather than a string, removing the need for signed integers.
Refactored the code to allow GPUs other than Xe2+ and adjusted function body positioning.
Provided binaries for macOS (Apple Silicon and Intel), Linux (CPU, Vulkan, ROCm, OpenVINO, SYCL), Android, Windows (CPU, CUDA 12/13, Vulkan, OpenCL, OpenVINO, SYCL, HIP), and openEuler.

The update ensures stability for users running Windows with Intel graphics by preventing crashes associated with newer driver versions.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency

Read original

github llama.cpp · just now Live

llama.cpp b10216 adds 1D pooling support to the Vulkan backend

The llama.cpp project released version b10216, which introduces full GGML_OP_POOL_1D support for the Vulkan backend. This update includes a new compute shader mirroring the existing pool2d implementation and fixes a crash that occurred when tensor dimensions resulted in negative end boundaries.

github llama.cpp · 2h ago

llama.cpp b10213 adds support for rotated kv cache quantization

The llama.cpp project has released version b10213, introducing support for rotated key-value cache quantization. This update is available across a wide range of platforms and hardware accelerators.

media r/LocalLLaMA · 3h ago

Initial testing of DeepSeek v4 Flash shows significant improvements in UI/UX design capabilities

Initial testing of the DeepSeek v4 Flash model indicates notable enhancements in its user interface and user experience design skills. Despite these improvements, the model is noted to be token hungry.

github llama.cpp · 4h ago

llama.cpp b10212 loads MTP tensors only when used

The llama.cpp project released version b10212, which includes a change to load Multi-Token Prediction (MTP) tensors only if they are actually used. This update ensures that MTP tensors are skipped during loading for remaining models that support the feature but do not require it.

github llama.cpp · 4h ago

llama.cpp b10210 corrects accepted tokens during draft token replay

The llama.cpp project has released version b10210, which includes a correction to the server logic for handling accepted tokens when draft token replay is required.