github llama.cpp · 1d ago · inference

llama.cpp b11260 adds FP32 GELU_ERF and GEGLU_ERF support

from English

The llama.cpp project has released version b11260, introducing support for FP32 GELU_ERF and GEGLU_ERF activation functions in the Hexagon backend. This update also includes optimizations to reduce register pressure within the associated kernels.

Added FP32 GELU_ERF and GEGLU_ERF support for Hexagon.
Reduced register pressure in hexagon kernels.
macOS Apple Silicon, Intel, and iOS binaries are available.
Linux builds cover CPU, Vulkan, CUDA 12/13, ROCm 10.0, OpenVINO, SYCL, and Snapdragon platforms.
Android arm64 builds include support for Snapdragon Hexagon NPU.
Windows releases provide CPU, OpenCL Adreno, CUDA 12/13, Vulkan, OpenVINO, SYCL, and ROCm 10.0 options.

This release expands hardware compatibility for specific activation functions and improves efficiency on supported accelerators.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency Local inference

Read original

github llama.cpp · 7h ago · 2 views

llama.cpp b11284 fixes OpenVINO GET_ROWS on quantized weight views

The llama.cpp project released build b11284, which includes a fix for the OpenVINO backend to correctly handle GET_ROWS operations on quantized weight views.

github llama.cpp · 10h ago · 2 views

llama.cpp adds GLM-5.3-Flash support with k-pool and MTP fixes

The llama.cpp project has added initial support for the GLM-5.3-Flash (GLM5-Next) model architecture, including migration to hybrid-index memory and early Multi-Token Prediction (MTP) capabilities.

github llama.cpp · 12h ago · 2 views

llama.cpp b11272 optimizes Hexagon concat op

The llama.cpp project released build b11272, which includes optimizations for the Hexagon backend. The primary change focuses on optimizing the concatenation operation to improve performance on Qualcomm Snapdragon hardware.

github llama.cpp · 1d ago · 1 view

llama.cpp b11258 removes built-in UI service worker when UI is not served

The llama.cpp project released build b11258, which includes a fix for the built-in web interface's service worker behavior. Previously, using flags like `--path` or `--no-ui` caused browsers to retain cached versions of the UI because the server returned a 404 for `/sw.js`, which does not trigger service worker removal.

media Hugging Face Forums · 2d ago · 4 views

Krea 2 LoRA Studio enables training on free Colab T4

Jordan Epstein has released Krea 2 LoRA Studio, a project designed to make the full Krea 2 LoRA workflow usable on a free Google Colab T4 GPU. The tool addresses memory constraints by implementing a staged workflow that manages cache preparation, training, and preview generation separately.