github vLLM · 1h ago · inference

v0.29.0rc2 fixes SHM worker cache for prefix-covered items

from English

The v0.29.0rc2 release includes a bugfix for the SHM worker cache to properly handle prefix-covered items.

Resolves an issue where prefix-covered items were not handled correctly in the SHM worker cache.

Importance 1/3 Trust 2/3 vLLM Multimodal

DeepSeek releases DeepSeek-V4-Flash-Vision-Exp on Hugging Face

DeepSeek has published the DeepSeek-V4-Flash-Vision-Exp model checkpoint on Hugging Face. The repository is now available for public access.

media MarkTechPost · 8d ago · 27 views

Alibaba's Qwen Team releases Qwen3.8-Flash-Next, a 125B MoE previewing Qwen4

Alibaba’s Qwen team has released Qwen3.8-Flash-Next, an open-weight multimodal Mixture-of-Experts model designed to preview the architecture for the upcoming Qwen4 series. The checkpoint pairs a 125B backbone with a 51B N-gram embedding table and a 4B multi-token prediction module, activating only 6B parameters per token.

media r/LocalLLaMA · 8d ago · 37 views

Zhipu AI releases GLM-5.3-Flash, a multimodal open-weight model

Zhipu AI has released GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series and the first open-weight release of the glm5_next architecture. The 320B-parameter model is trained on a 30T-token multimodal corpus and features a hybrid sparse and linear attention mechanism to reduce long-context serving costs.

lab Zhipu / Z.ai (GLM, HF) · 8d ago · 32 views

Zai releases GLM-5.3-Flash, a 320B multimodal model with sparse-linear attention

Zai has introduced GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. It features a hybrid architecture combining sparse and linear attention to reduce long-context serving costs while maintaining precise capabilities.

lab Zhipu / Z.ai (GLM, HF) · 8d ago · 28 views

ZhiPu releases GLM-5.3-Flash, a 320B-parameter multimodal model

ZhiPu introduces GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series, featuring a hybrid architecture that combines sparse and linear attention to reduce long-context serving costs while preserving precision.