arxiv arXiv cs.LG · 4h ago

Sublinearly Structured Deep Neural Networks Achieve Feature Learning Consistency for Compositional Functions

This study establishes feature-learning consistency guarantees for a broad subclass of deep neural networks characterized by sublinear growth in input/output dimensions and hidden neurons relative to sample size. The authors prove that these architectures achieve universal approximation for hierarchically compositional functions, even within the conventional over-parameterized regime where parameters exceed training samples.

arxiv arXiv cs.LG · 4h ago

TROPT: An Open Framework for Unifying and Advancing Discrete Text Optimization

TROPT is introduced as the first open-source framework that unifies discrete text-trigger optimization by standardizing execution and development under a single interface. It addresses current fragmentation by allowing users to customize end-to-end optimization recipes through interchangeable models, objectives, and optimizers.

arxiv arXiv cs.LG · 4h ago

FLKit: A Structured Onboarding Toolkit for Federated Learning in Health

FLKit is an open, community-maintained onboarding toolkit designed to help multidisciplinary teams navigate the federated learning lifecycle in health and life sciences research. It provides role-aware entry points for clinical, legal, governance, and technical contributors, addressing the practical barriers of scattered frameworks and governance obligations.

arxiv arXiv cs.LG · 4h ago

FairBED: A Bayesian Experimental Design Approach to Gathering Fairer Data

The article introduces FairBED, a framework that modifies the data acquisition process itself to gather inherently fairer data, addressing biases present in existing datasets. It provides novel formulations for quantifying dataset fairness based on the principle that fair datasets should be uninformative about sensitive attributes.

media r/LocalLLaMA · 4h ago

DeepSeek V4 by am17an · Pull Request #24162 · ggml-org/llama.cpp

A pull request submitted to the ggml-org/llama.cpp repository enables local execution of the DeepSeek V4 model.

arxiv arXiv cs.CL · 4h ago

DMV-Bench: Diagnosing Long-Horizon Multimodal Agents' Visual Memory with Incidental Cue Injection

Researchers introduce DMV-Bench, the first interactive benchmark designed to evaluate visual memory in multimodal agents within controlled environments. The study proposes DualMem, a parallel visual and verbal memory architecture that significantly outperforms existing systems on this new diagnostic tool.

arxiv arXiv cs.LG · 5h ago

Concordia: JIT-Compiled Persistent-Kernel Checkpointing for Fault-Tolerant LLM Inference

This paper introduces Concordia, a runtime designed to provide fault tolerance for long-running LLM agents by maintaining valuable state on GPUs without restarting the serving stack. The system utilizes a device-resident persistent kernel that interposes on GPU module loading to support PTX- and SASS-level instrumentation.

media r/LocalLLaMA · 5h ago

GLM 5.2 Q1_S vs Qwen 27B Q8: A Local LLM Comparison

An amateur comparison on consumer hardware demonstrates that the heavily quantized GLM-5.2 (Q1_S) outperforms the higher-bit Qwen 3.6 27B (Q8) in a complex coding task, despite significantly slower inference speeds.

media r/LocalLLaMA · 5h ago

Reddit user seeks flashy, feature-rich AI chat interface over minimalist options

A Reddit user is asking for recommendations on "flashy" and feature-heavy chat interfaces, specifically comparing LibreChat and OpenWebUI, for a technically inclined but AI-illiterate friend.

media r/LocalLLaMA · 5h ago

MiCA is now part of Hugging Face PEFT

The MiCA (Minor Component Adaptation) method has been merged into the main branch of the Hugging Face PEFT library, allowing users to install it directly from source. It is exposed through the existing LoRA interface by setting `init_lora_weights="mica"`.

media r/LocalLLaMA · 5h ago

AMD MI210 64GB vs DCU K100 64GB

A Reddit user compares the pricing and specifications of the AMD Instinct MI210 64GB and the Chinese DCU K100 64GB GPUs available on the Chinese eBay market. The discussion highlights that while both cards offer similar memory capacities, they differ significantly in price, bandwidth, and architectural details.

media r/LocalLLaMA · 5h ago

Update: First Manual Results from Testing Procedural Skill Transfer in Small Models

A manual experiment tested whether a procedural scaffold generated by a large model can transfer planning discipline to smaller models without fine-tuning or revealing the target answer. The results indicate that this approach significantly improves structural readability and composition in small models when applied across different Three.js domains.

arxiv arXiv cs.CL · 5h ago

Developmental approach reveals the statistical learning of Neural Language Models: Transformers generalize from the most abstract statistical patterns

This study investigates the statistical learning and mental representation of neural language models by training Generative Transformer models on a synthetic grammar and analyzing their internal representations at various stages.

arxiv arXiv cs.CL · 5h ago

Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents

This article identifies a distinct failure mode in large language model agents where they struggle to discard outdated facts in favor of current ones, even when comprehension is intact. The authors demonstrate that this "supersession gap" persists across model scales and memory sizes, indicating it is a trainable bottleneck rather than a limitation of context window or model strength.

github llama.cpp · 5h ago

llama.cpp b9838 Release: Builds for macOS, Linux, Windows, Android

The llama.cpp project has released version b9838, providing pre-built binaries for a wide range of operating systems and hardware accelerators. This release includes support for CPU, GPU (CUDA, Vulkan, ROCm, OpenCL), and specialized AI accelerators across macOS, Linux, Windows, Android, and openEuler.

arxiv arXiv cs.CL · 6h ago

Aloe-Vision: Robust Vision-Language Models for Healthcare

This work introduces Aloe-Vision, a family of open-source large vision-language models (7B and 72B) trained on the newly released Aloe-Vision-Data dataset to address data scarcity and robustness issues in healthcare AI. The authors demonstrate that their high-quality training mixture yields significant performance gains over baselines while maintaining general capabilities.

arxiv arXiv cs.CL · 6h ago

The Curse of Multiple Mediators: Hidden Interaction Effects in Activation Patching

A re-derivation of the activation patching estimand from causal mediation analysis reveals that the natural indirect effect (NIE) captures not only the causal effect through a specific component but also interaction effects (INT). These INT terms measure how much a component's causal effect depends on the state of other components in the model, challenging the assumption that NIE isolates individual contributions.

arxiv arXiv cs.CL · 6h ago

The Context-Ready Transformer

The authors introduce the context-ready transformer, a recurrent neural network architecture that pre-contextualizes each token before it enters a D-layer transformer block using a correction network.

arxiv arXiv cs.CL · 6h ago

EntMTP: Accelerating LLM Inference with Entropy Guided Multi Token Prediction

The authors propose Entropy-guided Multi-Token Prediction (EntMTP), a training-free scheduler that dynamically adjusts speculation depth during LLM inference based on local generation entropy. This approach addresses the inefficiency of static tree-based attention topologies by matching compute requirements to context predictability.

arxiv arXiv cs.CL · 6h ago

Ko-WideSearch: A Korean Breadth-Search Benchmark for Exhaustive Set Enumeration by Web Agents

The article introduces Ko-WideSearch, a new benchmark designed to evaluate the breadth-search capabilities of web agents in Korean, addressing the lack of exhaustive set enumeration metrics outside English.