github llama.cpp · 9d ago · inference

LLaMA.cpp Release b9663 Adds SYCL Support and New Binary Builds

from English

LLaMA.cpp release b9663 adds support for OP EXPM1 and all unit test cases for FLOOR, TRUNC, and ROUND. It includes updated binaries for macOS, Linux, Android, Windows, and openEuler, with support for SYCL (FP32 and FP16), Vulkan, CUDA 12.4 and 13.3, and ROCm 7.2, along with an updated UI.

Importance 1/3 Trust 2/3 llama.cpp API & product launches Hardware & chips Inference efficiency

Read original