The llama.cpp project has released version b10035, providing binaries for macOS, Linux, Windows, Android, and openEuler across CPU, GPU, and specialized hardware backends.
- The primary technical change is the extraction of Q1_0 elements via __byte_perm in CUDA (PR #25628).
- KleidiAI support on macOS/iOS Apple Silicon has been disabled.
- OpenEuler builds are available for x86 and aarch64 architectures, including ACL Graph support for 910b chips.
- Windows binaries now include support for CUDA 13.3 alongside the existing CUDA 12.4, as well as HIP and SYCL.
This release updates the codebase with specific hardware optimizations and provides updated binaries for various operating systems and accelerator types.