llama.cpp version b9702 includes a fix for router args not being forwarded to child instances. The release provides binaries for macOS, Linux, Android, Windows, and openEuler across multiple architectures and hardware acceleration options, including Vulkan, ROCm, OpenVINO, and SYCL.
llama.cpp Release b9702: Fixes and New Binaries
from English