media r/LocalLLaMA · 1h ago · open_models

Facebook releases MobileMoE, a family of on-device MoE language models

from English

Meta has released MobileMoE, a collection of on-device Mixture-of-Experts (MoE) language models designed to optimize the quality-efficiency trade-off for mobile devices. The family includes three model scales with sub-billion active parameters and weight footprints under 3 GB in INT4 format.

The models feature 0.3B, 0.5B, and 0.9B active parameters (1.3B, 2.8B, and 5.3B total), each available in Base, SFT, and QAT variants.
MobileMoE-L-Base is the pre-trained model with 922M active parameters, 32 layers, and a context length of 8,192 tokens.
The architecture utilizes 60 routed experts with top-k sigmoid routing and one shared expert, supporting English text input and output.
Released under the FAIR NC license in August 2026, the models are hosted on Hugging Face.

Importance 2/3 r/LocalLLaMA Meta AI Inference efficiency Open weights

Read original

arxiv arXiv cs.LG · 17h ago · 12 views

Quantization-Aware Healing recovers 4-bit LLMs faster than QAT

The authors introduce Quantization-Aware Healing (QAH), a pipeline that distills 4-bit students directly from uncompressed models to recover performance lost during structural compression and quantization. Applied to GPT-OSS 120B, this method produces Hypernova-60B, which matches or beats the bfloat16 source on 7 of 9 benchmarks while using roughly 4 times less weight memory.

arxiv arXiv cs.CL · 17h ago · 9 views

Quantization-Aware Healing recovers 4-bit LLMs faster than QAT

The authors introduce Quantization-Aware Healing (QAH), a method to recover reasoning and coding capabilities in structurally compressed, 4-bit large language models. Unlike standard quantization-aware training which re-fits the compressed model, QAH distills the 4-bit student directly from the original uncompressed model.

media Hugging Face Forums · 2d ago · 6 views

Xyntetik Runner trains LoRA directly through quantized GGUF weights

Joakimpalm-Zen has updated Xyntetik Runner to train LoRA adapters directly using the same quantized GGUF weights it serves for inference, eliminating the need for a separate FP16 training copy or runtime.

media MarkTechPost · 4d ago · 11 views

Liquid AI releases LFM2.5-DSpark draft models for up to 3.18x faster decoding

Liquid AI has released DSpark draft model checkpoints for three models in its LFM2.5 family: LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B. These drafters add a speculative decoding path to existing target models, allowing a roughly 300M-parameter draft to propose a block of nine candidate tokens that the target model verifies in a single forward pass.

lab Liquid AI · 4d ago · 15 views

Liquid AI releases DSpark draft models for LFM2.5 to accelerate inference

Liquid AI has released draft model checkpoints for its LFM2.5 family—specifically LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B—that utilize speculative decoding to significantly improve inference speed without compromising output quality.