github llama.cpp · just now · inference

llama.cpp b10431 adds recurrent state rollback for SSM models

from English

The llama.cpp project released version b10431, which introduces support for recurrent state (RS) rollback in the ggml_ssm_scan operation. This change enables RS rollback for Nemotron models on both CPU and CUDA backends.

Initial implementation of recurrent state rollback for Nemotron on CPU and CUDA.
Support for K > 1 in ssm_scan across all backends.
Replacement of static CUDA detection with a runtime fused_op API to check operation support.
Fallback to CPU when SSM rollback is not supported by the backend.
Addition of test-backend-ops for both CPU and CUDA to verify functionality.

This update allows users to run Nemotron models with recurrent state rollback capabilities on supported hardware configurations.

Importance 1/3 Trust 1/3 llama.cpp Inference efficiency

Read original

lab NVIDIA Research · just now Live

Nvidia presents FusionRelight for real-time portrait relighting via hybrid domain knowledge fusion

Researchers from Nvidia have introduced FusionRelight, a method for portrait relighting that combines physically plausible illumination transfer with identity preservation and compact real-time inference. The approach utilizes Hybrid Domain Knowledge Fusion (HDKF), a training framework that distills physics, reflectance, and realism priors from synthetic, One-Light-at-a-Time (OLAT), and in-the-wild data into a student model.

media r/LocalLLaMA · 3h ago

Nvidia presents FusionRelight for real-time portrait relighting via hybrid domain knowledge fusion

Qwen releases open weights for Qwen 3.8 27B

llama.cpp b10429 allows accessing /metrics and /slots during llama_decode()

llama.cpp b10430 allows virtual igpu devices

llama.cpp b10427 fuses SYCL FFN ops for up to 12.4% throughput gain