github llama.cpp · 1d ago · inference

llama.cpp release b9776 adds Vulkan and multiple hardware support

from English

llama.cpp version b9776 introduces Vulkan support for Linux and Windows, along with CPU, OpenCL, CUDA, and SYCL variants across macOS, Linux, Android, and Windows. The release also includes support for OpenVINO and ROCm, with UI available in a standalone package.

Importance 1/3 Trust 2/3 llama.cpp Inference efficiency Open weights

Read original