Source · Hugging Face Blog
lab Hugging Face Blog · 29d ago GPQA Diamond · 67.4% · 39 views

Multiverse Computing's QAH makes 4-bit GPT-OSS outperform its full-precision original

Multiverse Computing introduces Quantization-Aware Healing (QAH), a method that distills compressed, quantized large language models directly from their original pre-compression teachers. Applied to a GPT-OSS 120B model compressed to 60B parameters and quantized to MXFP4, the approach produces a model that beats its own full-precision bfloat16 version on 7 of 9 benchmarks.

lab Hugging Face Blog · 15h ago · 11 views

AISI releases verified evaluation results for six frontier models on five benchmarks

The UK AI Security Institute (AISI) has made publicly reported evaluation methods and findings available through EvalEval's Evaluation Cards platform to improve benchmark reproducibility. This release includes verified results, context, and configuration information for five specific benchmarks: HealthBench, FrontierMath, Humanity's Last Exam, SWE-Bench Pro, and Terminal-Bench 2.0.

lab Hugging Face Blog · 2d ago MMLU · 77.0% · 15 views

Multiverse reformulates LLM block removal as Ising optimization for deep compression

Multiverse has released a paper detailing a method that reframes large language model pruning as a constrained binary optimization problem mapped to an Ising glass. By treating transformer blocks as spins with pairwise couplings derived from the loss Hessian, the approach identifies optimal block removal configurations without requiring iterative benchmarking.

lab Hugging Face Blog · 8d ago · 16 views

ALTK-Evolve introduces consistency guidelines to halve agent reliability gaps

Researchers have introduced "consistency guidelines" within the ALTK-Evolve system, a new mechanism designed to address the variability in LLM agent performance that standard average accuracy metrics often hide. By identifying and stabilizing decision points prone to flipping, this approach significantly improves task success consistency without sacrificing overall capability.

lab Hugging Face Blog · 9d ago · 16 views

TRL v1.14 AsyncGRPOTrainer enables LoRA-only sync across Hugging Face Jobs

TRL v1.14 introduces LoRA support to the AsyncGRPOTrainer, allowing it to train a Low-Rank Adaptation adapter and synchronize only that small file to vLLM inference workers. This architecture decouples training and generation jobs on separate machines by using a shared Storage Bucket as a filesystem bridge, eliminating the need for NCCL or direct network communication between nodes.

lab Hugging Face Blog · 15d ago · 23 views

Multiverse Computing proposes boundary-aware self-distillation for precise LLM safety refusal

A Multiverse Computing paper introduces a method to train language models to refuse only specific harmful subsets of a topic, rather than the entire category, addressing the limitations of blunt topic-level guardrails. The approach uses boundary-aware self-distillation with coverage repair and in-distribution benign data to maintain safety while reducing false refusals on legitimate prompts.

lab Hugging Face Blog · 20d ago · 34 views

NeoMME releases efficient multimodal encoders with dense and late-interaction retrieval

Researchers introduce NeoMME, a family of 260M and 800M multilingual multimodal encoders that process text and raw image patches using a single bidirectional Transformer. Unlike generative visual language models, NeoMME does not rely on separate pretrained vision towers or causal decoders, training the entire model from scratch with a masked discrete-diffusion objective.