NVIDIA has released the Qwen3.6-27B-NVFP4 model on Hugging Face.
The checkpoint is now available for download.
media
r/LocalLLaMA
·
50d ago
·
src: 56d ago
·
open_models
NVIDIA releases Qwen3.6-27B-NVFP4 model
from English
Related articles
arxiv
arXiv cs.LG
·
22h ago
·
12 views
Quantization-Aware Healing recovers 4-bit LLMs faster than QAT
The authors introduce Quantization-Aware Healing (QAH), a pipeline that distills 4-bit students directly from uncompressed models to recover performance lost during structural compression and quantization. Applied to GPT-OSS 120B, this method produces Hypernova-60B, which matches or beats the bfloat16 source on 7 of 9 benchmarks while using roughly 4 times less weight memory.
arxiv
arXiv cs.CL
·
23h ago
·
9 views
Quantization-Aware Healing recovers 4-bit LLMs faster than QAT
The authors introduce Quantization-Aware Healing (QAH), a method to recover reasoning and coding capabilities in structurally compressed, 4-bit large language models. Unlike standard quantization-aware training which re-fits the compressed model, QAH distills the 4-bit student directly from the original uncompressed model.
media
r/LocalLLaMA
·
8d ago
·
16 views
NVIDIA serves Qwen 3.8 2.4T on GB300 NVL72 at 4K tokens/s per GPU
NVIDIA has demonstrated serving the Qwen 3.8 2.4T parameter model with configurable reasoning capabilities on its GB300 NVL72 hardware platform.
media
r/LocalLLaMA
·
10d ago
·
8 views
Qwen releases open weights for Qwen 3.8 27B
Qwen has released the open weights for its Qwen 3.8 27B model. The checkpoint is available on Hugging Face.
lab
NVIDIA Technical Blog
·
12d ago
·
14 views
Alibaba releases Qwen3.8-2.4T-A95B open weights for NVIDIA GB300 NVL72
Alibaba has released the open weights for Qwen3.8-2.4T-A95B (also known as Qwen3.8-Max), its largest open-weight model, designed to bring near-frontier capabilities to the open ecosystem.