A fork of llama.cpp introduces a --skip-layers flag that allows users to omit entire transformer blocks during load time, offering an alternative or complement to quantization for fitting models into limited hardware.
A Reddit user is seeking advice on the most effective method for testing model performance across various quantization levels prior to purchasing new hardware.
The llama.cpp b9840 release introduces conversion support for the DeepSeek V4 model, including specific handling for the Pro variant. This update integrates the new architecture into the library alongside various internal optimizations and bug fixes.
This study introduces LoadKAN, a novel hybrid framework that combines a feature-isolated temporal attention mechanism with a Kolmogorov-Arnold network (KAN) to address the lack of interpretability in deep learning-based electricity load forecasting.
The article introduces STAITUS, a unified framework for unsupervised video object tracking that addresses the limitations of existing slot-based representations by explicitly disentangling appearance from geometric pose. By applying temporal alignment only in appearance space and enforcing spatial separation within frames, the method prevents slots from locking onto static backgrounds during motion.
This study applies sparse autoencoders to MolFormer to mechanistically examine how molecular representations are built across layers, challenging the assumption that chemical language models only learn surface-level syntax.
This work introduces SkyJEPA, a JEPA-style model designed for real-time quadrotor control that addresses the error amplification issues inherent in autoregressive long-horizon forecasting. The approach combines a latent dynamics model with a physics-inspired prober to map frozen latents to interpretable states, enabling physically grounded predictions.
The authors introduce Collapsed Effective Operators, a method that condenses higher-order degrees of freedom into a single vertex-level operator using Schur complementation of a graded Laplacian. This approach yields a dense operator encoding long-range interactions mediated by topology and is applicable to arbitrary higher-order constructs.
An email sent from DeepSeek indicates that the official version of DeepSeek V4 is scheduled to launch in mid-July. This information was shared via a translated image originally available only to Chinese users.
A user reports a significant drop in inference speed when switching from GPT-OSS 20B Q4 to Gemma 4 12B Q8 using llama.cpp, with throughput falling from approximately 70 tokens per second to 10 tokens per second. The issue persists even when testing a Q5 model variant and disabling the thinking feature, which only yielded a marginal gain of two additional tokens per second.
The llama.cpp project has released version b9839, which includes a fix to restore Tailwind scanning in ignored worktrees. This update provides pre-built binaries for macOS, Linux, Android, Windows, and openEuler across various architectures and hardware acceleration backends.
OpenAI Economic Research has extended its AI Jobs Transition Framework to the European Union, utilizing ESCO taxonomy and Eurostat data to analyze how AI capabilities may reshape labor markets across member states.
This article introduces a selective forecasting framework that allows models to abstain from high-risk predictions by modeling the empirical percentile of forecasting errors through metalearning. By using scale-invariant statistics derived from recent lags, the method decouples rejection decisions from forecasts to enable transfer across heterogeneous time series.
This study benchmarks whether GeoShapley, a game-theoretic explainer, can recover spatially varying coefficients from machine learning models using location encoder embeddings. Eleven encoders from the TorchSpatial framework were evaluated against a synthetic process with known coefficients across grid, county, and global scales.
The article introduces Diffeomorphic Time Warping (DiffTW), a theoretical framework for time series classification that learns mappings between real-valued functions to overcome the discrete point matching limitations of Dynamic Time Warping (DTW). DiffTW approximates diffeomorphic transformations using the method of characteristics to solve linear transport equations, providing a theoretically grounded dissimilarity measure.
This study establishes feature-learning consistency guarantees for a broad subclass of deep neural networks characterized by sublinear growth in input/output dimensions and hidden neurons relative to sample size. The authors prove that these architectures achieve universal approximation for hierarchically compositional functions, even within the conventional over-parameterized regime where parameters exceed training samples.
TROPT is introduced as the first open-source framework that unifies discrete text-trigger optimization by standardizing execution and development under a single interface. It addresses current fragmentation by allowing users to customize end-to-end optimization recipes through interchangeable models, objectives, and optimizers.
FLKit is an open, community-maintained onboarding toolkit designed to help multidisciplinary teams navigate the federated learning lifecycle in health and life sciences research. It provides role-aware entry points for clinical, legal, governance, and technical contributors, addressing the practical barriers of scattered frameworks and governance obligations.
The article introduces FairBED, a framework that modifies the data acquisition process itself to gather inherently fairer data, addressing biases present in existing datasets. It provides novel formulations for quantifying dataset fairness based on the principle that fair datasets should be uninformative about sensitive attributes.
A pull request submitted to the ggml-org/llama.cpp repository enables local execution of the DeepSeek V4 model.