lab DeepSeek (Hugging Face) · 591d ago

DeepSeek releases V3 MoE language model with 671B parameters

from English

DeepSeek has released DeepSeek-V3, a Mixture-of-Experts (MoE) language model featuring 671 billion total parameters with 37 billion activated per token. The model is trained on 14.8 trillion tokens and utilizes Multi-head Latent Attention and an auxiliary-loss-free load balancing strategy.

DeepSeek-V3 achieves performance comparable to leading closed-source models while requiring only 2.788M H800 GPU hours for training.
It incorporates a Multi-Token Prediction (MTP) objective and distills reasoning capabilities from the DeepSeek-R1 series.
The model supports inference via libraries like Transformers, vLLM, SGLang, and LMDeploy.

The release provides open-source access to a high-performance base model with strong math and code capabilities.

Importance 3/3 DeepSeek (Hugging Face) DeepSeek Open weights Reasoning models

Read original

arxiv arXiv cs.AI · 41d ago

RaDaR: A specialized reasoning LLM for accelerating rare disease diagnosis

Researchers present RaDaR, an open-source 32B parameter reasoning large language model designed to accelerate the diagnosis of rare diseases by addressing challenges in clinical deployability and data scarcity. The model was trained on nearly 50,000 public cases and over 100,000 synthetic cases, demonstrating superior performance across benchmarks and external validation centers.

arxiv arXiv cs.LG · 53d ago

Baseline Evaluation of Open-Source LLMs for Multi-Label ATT&CK Classification

A ground-truth dataset of 2,076 human-annotated sentences from 83 complex CTI reports was constructed and mapped to 114 ATT&CK techniques with \k{appa} = 0.68 inter-annotator agreement. Seven open-source LLMs ranging from 8B to 236B parameters were evaluated, achieving a maximum micro-averaged F1 score of 0.22. Parameter size showed a statistically significant positive correlation with F1 score, while prompt strategy and temperature did not yield significant improvements, indicating current open-source LLMs are insufficient for production-grade ATT&CK classification.

arxiv arXiv cs.CL · 53d ago · 2 views

LLMs Predict Dementia and Depression from Clinical Speech

A study uses open-weight large language models to assess dementia and depression severity from clinical interviews. LLMs achieve accurate zero-shot depression prediction (MAE 0.60) and improved dementia assessment with feature extraction (MAE 0.78), reducing errors by up to 35%. Pause-enriched transcripts match human transcriptions, supporting automated screening pipelines for neuropsychiatric disorders.

lab DeepSeek (Hugging Face) · 438d ago

DeepSeek-R1-0528 improves reasoning and AIME accuracy to 87.5%

DeepSeek has released DeepSeek-R1-0528, a minor version upgrade that significantly enhances depth of reasoning and inference capabilities through increased computational resources and algorithmic optimizations during post-training.

lab DeepSeek (Hugging Face) · 503d ago

DeepSeek-V3-0324 improves reasoning, coding, and Chinese writing over DeepSeek-V3

DeepSeek has released DeepSeek-V3-0324, a model update that demonstrates notable improvements over its predecessor, DeepSeek-V3, particularly in reasoning capabilities, code executability, and Chinese writing proficiency.