The llama.cpp project has released version b10010, which introduces new command-line options for configuring Cross-Origin Resource Sharing (CORS) in its built-in HTTP server.

  • The server now supports `--cors-*` flags to control CORS behavior.
  • A special "localhost" value is available for the origin settings.
  • Tests have been added and updated to cover the new functionality.
  • Binaries are provided for macOS (Apple Silicon and Intel), iOS, Linux (Ubuntu x64, arm64, s390x with CPU, Vulkan, ROCm 7.2, OpenVINO, SYCL), Android (arm64), Windows (CPU, OpenCL Adreno, CUDA 12/13, Vulkan, OpenVINO, SYCL, HIP), and openEuler.

This update allows users to manage cross-origin requests more flexibly when running the llama.cpp server locally.