The llama.cpp project released version b9957, which focuses on improving the server's tooling infrastructure. The update introduces a `tools_io` abstraction and its basic implementation while removing the `apply_diff` function.

  • Improved edit tool functionality
  • Added tools_io abstraction and tools_io_basic
  • Moved utils to class member and added const qualifiers
  • Fixed build issues
  • Disabled macOS Apple Silicon KleidiAI support
  • Provided binaries for macOS, Linux, Android, Windows, and openEuler across CPU, GPU, and various accelerators like CUDA, Vulkan, ROCm, and OpenVINO

This release updates the server-side capabilities and provides updated binaries for a wide range of hardware platforms.