Research paper
arxiv arXiv cs.LG · 1d ago HealthBench · 50.1% · 10 views

Fathom-Vaidya improves medical reasoning with rubric-based rewards

The authors introduce Fathom-Vaidya, a 30B parameter model that uses synthetic data and rubric-based reinforcement learning to enhance diagnostic and clinical healthcare reasoning. The training framework first applies rule-guided RL to MedBullets-derived questions for diagnosis, then utilizes 5.3k synthetic multi-turn scenarios with multi-dimensional rubrics for interactive clinical tasks.

arxiv arXiv cs.AI · 1d ago HealthBench · 50.1% · 12 views

Fathom-Vaidya improves medical reasoning with rubric-based rewards

The authors introduce Fathom-Vaidya, a 30B parameter model that uses synthetic data and rubric-based reinforcement learning to enhance both diagnostic and clinical healthcare reasoning. The training framework first targets diagnostic accuracy using MedBullets-derived questions and then addresses multi-turn clinical interactions through 5.3k generated scenarios with multi-dimensional rubrics.

arxiv arXiv cs.AI · 2d ago · 18 views

CodeMidas scales agentic coding RL environments using source code

Researchers introduce CodeMidas, an agentic pipeline that constructs reinforcement learning environments from implemented functionality in open-source codebases, using source code as the sole input. The method allocates agentic compute to explore functionality, construct execution-grounded tests, and validate tasks through repeated rollouts, resulting in a dataset of 5,545 training tasks across 23 programming languages. Training MiMo-V2.5 on these tasks with GRPO improves performance on five diverse benchmarks, including DeepSWE (+11.7%), ProgramBench (+17%), and Terminal-Bench v2.1 (+8.5%). Trajectory analysis indicates the RL-trained agent exhibits better behaviors such as increased codebase exploration and more diverse self-verification. These results establish source code as a scalable foundation for constructing RL environments that improve coding agents across diverse software tasks.

media Hugging Face Forums · 3d ago · 16 views

Researcher seeks one independent annotator to resolve LLM agreement ambiguity

A researcher is requesting a single independent human annotator to label 100 Turkish narrative scenes in order to determine whether low inter-rater agreement stems from the interpretive nature of the task or from underspecified annotation definitions. The study found that four LLMs and a rule-based detector agreed with each other and the human reference at roughly chance level, with Cohen’s κ scores ranging from 0.000 to 0.185.

arxiv arXiv cs.AI · 8d ago · 24 views

Atria Dawn Preview: foundation agentic language model for scientific research

Atria Dawn Preview is a foundation agentic language model designed for scientific research and engineering workflows, trained via a Verifiable Experience Pipeline that connects tool-mediated interactions to executable environments. Across 16 benchmarks spanning real-world research, engineering, and digital work, the model is competitive with frontier agents and achieves the highest reported score on five of them.