media InfoQ · 551d ago

DeepSeek open-sources DeepSeek-R1 LLM with performance comparable to OpenAI's o1

from English

DeepSeek has open-sourced DeepSeek-R1, a large language model fine-tuned using reinforcement learning to enhance reasoning capabilities. The model achieves results on par with OpenAI's o1 on benchmarks like MATH-500 and SWE-bench.

Based on the mixture of experts DeepSeek-V3, it uses Group Relative Policy Optimization (GRPO) for training.
The team addressed RL "cold start" issues by adding supervised fine-tuning with chain-of-thought examples before reinforcement learning.
Distilled versions for Qwen and Llama were released, outperforming larger models like GPT-4 on math and coding tasks.
DeepSeek-R1 ranked #3 overall in the LMArena shortly after release, leading in coding and math categories.

The open-source license permits using model outputs for distillation, potentially advancing the state of the art for language models of all sizes.

Importance 3/3 Beats a top-lab benchmark InfoQ DeepSeek Open weights Reasoning models

Read original

arxiv arXiv cs.AI · 41d ago

RaDaR: A specialized reasoning LLM for accelerating rare disease diagnosis

Researchers present RaDaR, an open-source 32B parameter reasoning large language model designed to accelerate the diagnosis of rare diseases by addressing challenges in clinical deployability and data scarcity. The model was trained on nearly 50,000 public cases and over 100,000 synthetic cases, demonstrating superior performance across benchmarks and external validation centers.

arxiv arXiv cs.LG · 53d ago

Baseline Evaluation of Open-Source LLMs for Multi-Label ATT&CK Classification

A ground-truth dataset of 2,076 human-annotated sentences from 83 complex CTI reports was constructed and mapped to 114 ATT&CK techniques with \k{appa} = 0.68 inter-annotator agreement. Seven open-source LLMs ranging from 8B to 236B parameters were evaluated, achieving a maximum micro-averaged F1 score of 0.22. Parameter size showed a statistically significant positive correlation with F1 score, while prompt strategy and temperature did not yield significant improvements, indicating current open-source LLMs are insufficient for production-grade ATT&CK classification.

arxiv arXiv cs.CL · 53d ago · 2 views

LLMs Predict Dementia and Depression from Clinical Speech

A study uses open-weight large language models to assess dementia and depression severity from clinical interviews. LLMs achieve accurate zero-shot depression prediction (MAE 0.60) and improved dementia assessment with feature extraction (MAE 0.78), reducing errors by up to 35%. Pause-enriched transcripts match human transcriptions, supporting automated screening pipelines for neuropsychiatric disorders.

lab DeepSeek (Hugging Face) · 438d ago

DeepSeek-R1-0528 improves reasoning and AIME accuracy to 87.5%

DeepSeek has released DeepSeek-R1-0528, a minor version upgrade that significantly enhances depth of reasoning and inference capabilities through increased computational resources and algorithmic optimizations during post-training.

lab DeepSeek (Hugging Face) · 503d ago

DeepSeek-V3-0324 improves reasoning, coding, and Chinese writing over DeepSeek-V3

DeepSeek has released DeepSeek-V3-0324, a model update that demonstrates notable improvements over its predecessor, DeepSeek-V3, particularly in reasoning capabilities, code executability, and Chinese writing proficiency.