A pull request supporting DeepSeek V4 has been merged into the llama.cpp repository, enabling users to run the model locally.

  • The merge is available at https://github.com/ggml-org/llama.cpp/pull/24162.
  • Users can update their installation via git pull and cmake.
  • The model weights are distributed in GGUF format.