media Hugging Face Forums · 2d ago · open_models

MB-Bidram shares experimental WideNDepth architecture separating reasoning from knowledge

from English

MB-Bidram has released an experimental neural architecture called WideNDepth (WND) designed to separate reasoning capabilities from knowledge storage. The model consists of a "Wide part" that functions as memory and a "Depth part" that acts as the reasoner.

WND is an experimental architecture where different parts focus on distinct tasks: wide for memory and depth for reasoning.
WiND, a minimal PyTorch framework for building WideNDepth models, is also open-sourced alongside the architecture.
The project is presented as a work in progress with room for improvement rather than a finished solution.

The author invites the community to explore, experiment with, and potentially improve the library and architecture.

Importance 1/3 Trust 1/3 Hugging Face Forums Research paper Training methods

Read original

arxiv arXiv cs.LG · 1d ago · 9 views

Fathom-Vaidya improves medical reasoning with rubric-based rewards

The authors introduce Fathom-Vaidya, a 30B parameter model that uses synthetic data and rubric-based reinforcement learning to enhance diagnostic and clinical healthcare reasoning. The training framework first applies rule-guided RL to MedBullets-derived questions for diagnosis, then utilizes 5.3k synthetic multi-turn scenarios with multi-dimensional rubrics for interactive clinical tasks.

arxiv arXiv cs.AI · 1d ago · 12 views

Fathom-Vaidya improves medical reasoning with rubric-based rewards

The authors introduce Fathom-Vaidya, a 30B parameter model that uses synthetic data and rubric-based reinforcement learning to enhance both diagnostic and clinical healthcare reasoning. The training framework first targets diagnostic accuracy using MedBullets-derived questions and then addresses multi-turn clinical interactions through 5.3k generated scenarios with multi-dimensional rubrics.

arxiv arXiv cs.CL · 1d ago · 12 views

Fathom-Vaidya improves medical reasoning with rubric-based rewards

The authors introduce Fathom-Vaidya, a 30B parameter model that uses synthetic data and rubric-based reinforcement learning to enhance both diagnostic and clinical healthcare reasoning.

media Hugging Face Forums · 3d ago · 18 views

Proposal: Progressive knowledge transfer from Qwen 9B to 27B for a fixed 4B model

A user on the Hugging Face forums proposes an experiment in progressive knowledge transfer, where a fixed-size student model (Qwen 4B) learns sequentially from increasingly larger teacher models rather than directly from the largest available one.

arxiv arXiv cs.LG · 7d ago · 20 views

OpenAI releases Open-1B with fully auditable training run

OpenAI has released Open-1B, a language model trained under a regime where every operation during training is independently reproducible on heterogeneous commodity hardware with bitwise certainty. This approach addresses the reproducibility issues inherent in open-source models by imposing a definite order on sources of nondeterminism, such as GPU kernel reductions and data batch ordering.