media Hugging Face Forums · 3d ago · open_models

Biological JEPA models disease progression using biological constraints

from English

A new open-source project called Biological JEJA combines JEPA-style representation learning with biological constraints to model how diseases progress over time. The approach was tested on real ADNI data from 2,347 patients and compared against several other models.

The method focuses on learning representations that capture disease changes over time rather than just predicting a patient's current state.
It utilizes real-world data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset.
The project includes patient-level inference and an evaluation framework that compares results with LLM heads.

The author is seeking feedback on the biological constraints, experimental setup, and the convincing nature of the results.

Importance 1/3 Trust 1/3 Hugging Face Forums Research paper Retrieval & RAG

Read original

arxiv arXiv cs.AI · 2d ago · 1 view

RareDx uses graph-grounded policy optimization to improve rare-disease diagnosis

The authors introduce RareDx, a system that couples controlled evidence use with knowledge-graph-grounded policy optimization to address the long-tail reasoning problem of rare-disease diagnosis. The training pipeline combines Top-10 post-training with RareDx-KGPO, which projects predictions into a canonical disease graph and integrates curated graded relevance, ontology proximity, biomedical similarity, and phenotype consistency.

arxiv arXiv cs.AI · 3d ago · 15 views

Highlight-Then-Summarize compresses evidence to improve long-context understanding

Researchers propose Highlight-Then-Summarize (H2S), a compress-then-reason paradigm that identifies question-relevant evidence and integrates it into a compact summary before generating an answer. The team constructs H2S-Dataset with 6,647 examples and introduces H2S-RL to provide process-level rewards for evidence selection.

arxiv arXiv cs.CL · 3d ago · 6 views

Highlight-Then-Summarize compresses evidence for better long-context understanding

Researchers propose Highlight-Then-Summarize (H2S), a compress-then-reason paradigm that identifies question-relevant evidence and integrates it into a compact summary before generating an answer. To support this approach, the team constructed H2S-Dataset with 6,647 examples from 11 benchmark families and introduced H2S-RL for process-level rewards.

arxiv arXiv cs.CL · 7d ago · 6 views

R3Con applies relevance realization principles to improve large-scale reasoning

Researchers propose R3Con, a harness that operationalizes cognitive theory principles for constructing effective representations of very large contexts. The system addresses the challenge of assembling interdependent information scattered across vast sources beyond standard model context limits.

media Hugging Face Forums · 34d ago · 44 views

Ontological inversion: cross-model vector memory for steering and recall

A preprint by independent researcher Jason Van Pham proposes translating continuous representations between frozen models to enable steering, recall, and reasoning without weight editing. The work introduces a method where concepts are compiled into residual directions in one model's space and mapped via an affine transformation into another model's hidden layers.