The llama.cpp project has introduced a new `/v1/systemone` API endpoint to support specific model architectures including laya, julia-1, lev, openjev, and kev. This update includes the necessary server code, conversion scripts, and documentation to enable these models within the llama.cpp ecosystem.

  • Added `/v1/systemone` API endpoint for laya, julia-1, lev, openjev, and kev models.
  • Implemented model loading and conversion support for the new architectures.
  • Added vision support and shared prompt prefix capabilities.
  • Included an `openjev` tiny model for testing purposes.
  • Updated documentation and improved user experience for the new feature.

This release provides developers with the infrastructure to run and serve these specific model types using the llama.cpp server.