github llama.cpp · 1h ago · inference

mtmd adds WebP support via ffmpeg

from English

The mtmd component in llama.cpp now supports the WebP image format through ffmpeg integration.

Enables processing of WebP images within the mtmd framework.
Relies on ffmpeg for decoding functionality.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency

llama.cpp b10568 uses ggml_rope_set_offset() for DeepSeek 2

The llama.cpp project released build b10568, which updates the model handling to use the `ggml_rope_set_offset()` function. This change is partially applied to support DeepSeek 2.

github llama.cpp · 11h ago · 4 views

llama.cpp v0.2.0 release with ggml 0.21.0 and Kleidiai SME2 support

The llama.cpp project has released version 0.2.0, which includes a synchronization with the ggml library bumped to version 0.21.0. This update introduces several backend improvements and new features across various hardware platforms.

media Hugging Face Forums · 17h ago · 1 view

Celestium Engine adds VRAM optimizations and CPU fallback for SDXL

The Celestium Engine has introduced several upgrades to improve SDXL performance on low-VRAM hardware. These changes focus on memory management, stability, and fallback mechanisms to ensure consistent generation even on constrained systems.

github llama.cpp · 20h ago · 2 views

llama.cpp b10549 enables tensor split for LFM2/LFM2MOE

The llama.cpp project has released version b10549, which primarily introduces support for tensor splitting in LFM2 and LFM2MOE models.

github vLLM · 23h ago · 4 views

vLLM v0.28.0rc2 adds DFlash2 Spec Decode with local convolution and candidate selector

The vLLM project released version 0.28.0rc2, which includes the DFlash2 speculative decoding feature.