The llama.cpp project has released version b9994, which introduces Q2_0 quantization support via pull request #25419. This update provides pre-built binaries for macOS, Linux, Windows, Android, and openEuler across various hardware backends.

  • Added Q2_0 support to the metal backend.
  • Disabled KleidiAI support for macOS/iOS Apple Silicon builds.
  • Provided binaries for CPU, Vulkan, CUDA (12.4 and 13.3), ROCm, OpenVINO, SYCL, HIP, and OpenCL Adreno.
  • Included iOS XCFramework and UI packages in the release.