github llama.cpp · 1h ago · inference

llama.cpp b10270 adds Qwen3-TTS support with breaking llama-tts changes

from English

The llama.cpp project released version b10270, introducing support for the Qwen3-TTS model. This update includes a breaking change to the llama-tts binary and implements significant architectural modifications to handle the new text-to-speech workflow.

Added support for converting and loading Qwen3-TTS components, including the main model, encoder, speaker encoder, and code_predictor.
Introduced a new mtmd gen API and renamed the CODE2WAV component to GEN_WAV.
Implemented voice clone capabilities and preserved key-value states between calls for improved continuity.
Added llama_model_get_tok_embd and mtmd_helper_gen_audio APIs for enhanced model interaction.
Included security fixes, documentation updates, and support for various hardware backends across macOS, Linux, Windows, and Android.

Importance 1/3 Trust 1/3 llama.cpp Hugging Face Local inference Voice & audio

Read original

github llama.cpp · 4d ago · 8 views

llama.cpp b10208 adds oneMKL GEMM flash attention for XMX-accelerated prompt processing

The llama.cpp b10208 release introduces SYCL support for oneMKL GEMM flash attention, enabling XMX hardware acceleration for prompt processing. This change significantly improves inference speed on Intel Arc GPUs by utilizing MKL kernels instead of the default TILE path.

github llama.cpp · 13d ago · 2 views

llama.cpp b10089 adds full k-quant and i-quant support to CUDA GET_ROWS

The llama.cpp b10089 release extends CUDA GET_ROWS operations to support k-quants, i-quants, and mxfp4 quantization formats. This change ensures that all quantized GGML types can now take the direct device path for embedding lookups.

lab Hugging Face Blog · 20d ago · 14 views

Hume releases Real World VoiceEQ benchmark for human quality of voice AI

Hume has introduced Real World VoiceEQ, a benchmark designed to evaluate the human quality of voice interaction by assessing how well systems recognize and produce acoustic information beyond transcripts. The benchmark evaluates over 40 proprietary and open-source models across 15+ dimensions using more than 60 metrics derived from 785,000 TTS and 48,000 STS human ratings.

arxiv arXiv cs.CL · 23d ago

Freya-TTS releases tokenizer-free Turkish TTS model with 8.0% WER

Researchers introduce Freya-TTS, a compact, tokenizer-free text-to-speech model optimized for Turkish that achieves an 8.0% word error rate on the Freya-TR-Eval benchmark. The 183.2M-parameter non-autoregressive conditional flow-matching Diffusion Transformer operates in the frozen continuous latent space of AudioVAE2, enabling high-quality 48 kHz reconstruction without a phonemizer or discrete speech tokenizer.

media r/LocalLLaMA · 33d ago · 7 views

Andi from Hugging Face demonstrates a fully open-source voice pipeline using Gemma 4 31B

Andi from Hugging Face has released a fully open-source and free-to-use demo that creates a voice interaction pipeline. The system integrates Nvidia's parakeet, the Gemma 4 31B model served by Cerebras, and custom inference for Qwen3TTS.