media r/LocalLLaMA · 2d ago · open_models

inclusionAI releases Ling-3.0-flash-VL multimodal model

from English

inclusionAI has released the open-source Ling-3.0-flash-VL model, which extends the language and reasoning capabilities of its predecessor with native image and video understanding.

The 124B-parameter model activates only 5.5B parameters per token and supports a context window of up to 1M tokens. Its architecture features a ViT visual encoder aligned via an MLP projector, VideoRoPE for temporal encoding, and a hybrid backbone alternating KDA and Gated MLA layers.

This design integrates visual information into real-world reasoning and agentic workflows while maintaining inference efficiency through sparse Mixture of Experts.

Importance 2/3 r/LocalLLaMA Multimodal Open weights

Read original

media r/LocalLLaMA · 5h ago · 3 views

DeepSeek releases V4-1 Flash, a 552B MoE model with 1M token context

DeepSeek has released its new model, DeepSeek V4-1 Flash. It is a multimodal Mixture-of-Experts (MoE) model featuring a 552 billion parameter backbone.

lab Hugging Face Blog · 7d ago · 18 views

NeoMME releases efficient multimodal encoders with dense and late-interaction retrieval

Researchers introduce NeoMME, a family of 260M and 800M multilingual multimodal encoders that process text and raw image patches using a single bidirectional Transformer. Unlike generative visual language models, NeoMME does not rely on separate pretrained vision towers or causal decoders, training the entire model from scratch with a masked discrete-diffusion objective.

media r/LocalLLaMA · 10d ago · 6 views

DeepSeek releases DeepSeek-V4-Flash-Vision-Exp on Hugging Face

DeepSeek has published the DeepSeek-V4-Flash-Vision-Exp model checkpoint on Hugging Face. The repository is now available for public access.

media MarkTechPost · 15d ago · 40 views

Alibaba's Qwen Team releases Qwen3.8-Flash-Next, a 125B MoE previewing Qwen4

Alibaba’s Qwen team has released Qwen3.8-Flash-Next, an open-weight multimodal Mixture-of-Experts model designed to preview the architecture for the upcoming Qwen4 series. The checkpoint pairs a 125B backbone with a 51B N-gram embedding table and a 4B multi-token prediction module, activating only 6B parameters per token.

media r/LocalLLaMA · 15d ago · 57 views

Zhipu AI releases GLM-5.3-Flash, a multimodal open-weight model

Zhipu AI has released GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series and the first open-weight release of the glm5_next architecture. The 320B-parameter model is trained on a 30T-token multimodal corpus and features a hybrid sparse and linear attention mechanism to reduce long-context serving costs.