media r/LocalLLaMA · 1h ago · open_models

Hugging Face releases The Stack v3, the largest open code dataset

from English

Hugging Face has released The Stack v3, described as the largest open code dataset to date. The release provides two distinct access methods to accommodate different user needs.

stack-v3-train: A near-deduplicated, quality-filtered, and PII-redacted version with inline contents, accessible via the Hugging Face datasets library.
stack-v3-full: The entire 114 TB corpus stored as an HF Storage Bucket, preserving all duplicates with cluster IDs and stubs for excluded files.

This release offers researchers and developers access to a massive, raw code repository while also providing a pre-processed variant for immediate training use.

Importance 2/3 r/LocalLLaMA Hugging Face Open weights Training data

Read original

arxiv arXiv cs.AI · 7d ago

RAGU introduces multi-step GraphRAG engine with compact Meno-Lite-0.1 extractor

RAGU is an open-source modular GraphRAG engine that improves structured knowledge integration by separating entity extraction from consolidation. It utilizes a two-stage typed extraction process, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection to reduce noise and brittleness found in single-pass systems.

lab IBM Research (Granite) · 8d ago

IBM open-sources CodeAlchemy, a massive synthetic dataset of high-quality code

IBM has open-sourced CodeAlchemy, a pipeline and synthetic dataset designed to improve AI model performance by pairing code with execution traces. The release includes nearly 1 trillion tokens across 15 programming languages, totaling at least 200 times the size of Wikipedia.

arxiv arXiv cs.CL · 10d ago · 1 view

RAGU introduces multi-step GraphRAG with compact Meno-Lite-0.1 extractor

RAGU is an open-source modular GraphRAG engine that improves structured knowledge integration by separating extraction from consolidation through a two-stage process involving typed extraction, deduplication, summarization, and community detection.

arxiv arXiv cs.CL · 11d ago

Freya-TTS releases tokenizer-free Turkish TTS model with 8.0% WER

Researchers introduce Freya-TTS, a compact, tokenizer-free text-to-speech model optimized for Turkish that achieves an 8.0% word error rate on the Freya-TR-Eval benchmark. The 183.2M-parameter non-autoregressive conditional flow-matching Diffusion Transformer operates in the frozen continuous latent space of AudioVAE2, enabling high-quality 48 kHz reconstruction without a phonemizer or discrete speech tokenizer.

arxiv arXiv cs.AI · 15d ago

DiaLLM investigates robustness-generation gap in English dialect adaptation

The DiaLLM study addresses the disconnect between understanding and producing dialectal English by continually pretraining three open-weight language model families on the International Corpus of English. It applies implicit and explicit post-training paradigms combined with three alignment strategies to compare Australian, Indian, and Northern British English.