github llama.cpp · 1h ago · inference

llama.cpp b10636 disables npm UI build by default and cleans up CI

from English

The llama.cpp project released version b10636, which changes the default behavior for building the web interface. The npm-based UI build is now disabled by default (LLAMA_BUILD_UI=OFF), with the UI instead embedded from local sources or prebuilt downloads.

CI jobs no longer npm-build the UI; server-sanitize does not require Node.js anymore.
The ui-build artifact is renamed to llama-ui.zip and reused across release jobs.
macOS Apple Silicon builds with KleidiAI are disabled.
Windows arm64 CUDA 13 support is marked as preview.

This release provides binaries for macOS, Linux, Windows, Android, and openEuler across various hardware backends including CPU, Vulkan, ROCm, OpenVINO, SYCL, and CUDA.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency Local inference

Read original

github llama.cpp · 2h ago · 1 view

llama.cpp b10635 unblocks mmq for MoE on sm_60

The llama.cpp project released version b10635, which includes specific updates to CUDA support. The primary change is the unblocking of mixed-precision matrix multiplication (mmq) for Mixture of Experts (MoE) architectures on compute capability 6.0 (sm_60) GPUs.

github llama.cpp · 2d ago · 11 views

llama.cpp b10635 unblocks mmq for MoE on sm_60

llama.cpp b10604 adds Deepseek 4 DSV4 support and macOS/iOS binaries

llama.cpp b10598 uses pillow-accurate resize algo and corrects resize_algo for all models

llama.cpp b10593 fixes DeepseekV4 rollback and model loading

llama.cpp b10584 fixes draft context sizing to prevent server 500 errors