LLaMA.cpp releases version b9744 with updated binaries for macOS, Linux, Android, Windows, and openEuler. The release includes support for multiple architectures and hardware accelerators such as Vulkan, CUDA, OpenVINO, SYCL, and ROCm. A UI package is also available for user interface access.
LLaMA.cpp Release b9744: New Binaries and Features
from English