The llama.cpp project has released version b9994, which introduces Q2_0 quantization support via pull request #25419. This update provides pre-built binaries for macOS, Linux, Windows, Android, and openEuler across various hardware backends.
- Added Q2_0 support to the metal backend.
- Disabled KleidiAI support for macOS/iOS Apple Silicon builds.
- Provided binaries for CPU, Vulkan, CUDA (12.4 and 13.3), ROCm, OpenVINO, SYCL, HIP, and OpenCL Adreno.
- Included iOS XCFramework and UI packages in the release.