The llama.cpp project has released version b9946, introducing significant optimizations for Qualcomm Hexagon processors alongside new build artifacts for multiple platforms.

  • Hexagon unary operations now tile wide rows to avoid VTCM overflow and replace divisions with fastdiv.
  • The update includes tracing instrumentation and streamlined HVX kernels for improved code generation.
  • macOS Apple Silicon binaries are available, though KleidiAI support remains disabled.
  • New Linux builds cover CPU, Vulkan, ROCm 7.2, OpenVINO, and SYCL targets.
  • Windows releases now include CUDA 13 support alongside existing CUDA 12, OpenCL, and HIP options.

This release provides updated binaries for desktop and mobile environments while enhancing performance on Hexagon-based hardware.