media r/LocalLLaMA · 1h ago · open_models

Meituan releases LongCat-Flash-Lite-Sparse with 1M context window

from English

Meituan has released the weights for LongCat-Flash-Lite-Sparse, a new variant of its LongCat-Flash-Lite model. The update introduces LongCat Sparse Attention (LSA) to replace dense MLA and extends native context length support to 1 million tokens.

Replaces dense Multi-Head Latent Attention with LongCat Sparse Attention (LSA).
Natively supports context lengths of up to 1M tokens, compared to the previous 256k limit.
Weights are now available for download on Hugging Face.

Importance 2/3 r/LocalLLaMA Inference efficiency Open weights

Read original

media MarkTechPost · 2d ago

Tencent releases AngelSpec, a unified training framework for MTP and block-parallel speculative decoding

Tencent has open-sourced AngelSpec, a torch-native training framework that supports both autoregressive multi-token prediction (MTP) and block-parallel DFlash-family drafters for Hy3 models. The system treats workload heterogeneity as a primary design constraint, allowing it to specialize structure, training data, and verification depth based on specific use cases.

lab Liquid AI · 4d ago

Liquid AI releases LFM2.5-Encoders for fast long-context inference on CPU

Liquid AI has released two new encoder models, LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, designed to provide high-quality bidirectional encoding with efficient scaling up to an 8,192-token context length.

lab Hugging Face Blog · 4d ago

Liquid AI releases LFM2.5-Encoders for fast long-context CPU inference

Liquid AI has released two open-weight encoder models, LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, designed for efficient long-context inference on CPUs. These models support an 8,192-token context and are built by converting LFM2 decoder backbones into bidirectional encilers using masked language modeling.

lab Tencent Hunyuan (HF) · 9d ago · 2 views

Tencent open-sources Hy-MT2 multilingual translation models and IFMTBench

Tencent has released the Hy-MT2 family of "fast-thinking" multilingual translation models, including 1.8B, 7B, and 30B-A3B (MoE) sizes, along with the IFMTBench benchmark for evaluating instruction-following capabilities.

media MarkTechPost · 15d ago · 5 views

PrismML releases Bonsai 27B, compressing Qwen3.6-27B to 1-bit and ternary weights

PrismML has released Bonsai 27B, a low-bit quantization of the Qwen3.6-27B model that enables running large multimodal models on laptops and phones without retraining.