Research paper
media Interconnects · 7d ago

State of the Interconnects Blog Mid-2026

The author outlines three core goals: clarifying frontier AI model evolution, building an open AI ecosystem, and creating institutions to support these missions. Interconnects serves as a raw, independent voice for frontier AI thinking, with a dedicated technical audience of over 70K subscribers. The blog maintains paywalled comments to prevent AI-generated noise, and the author plans to reach 1000 paid subscribers by summer, emphasizing financial sustainability and independence amid rising AI service costs.

arxiv arXiv cs.LG · 8d ago

MGUP: Momentum-Gradient Alignment for Selective Optimization

MGUP introduces a selective update mechanism that applies larger step-sizes to a fixed proportion of parameters in stochastic optimization, while using smaller, non-zero step-sizes for the rest. It integrates seamlessly with optimizers like AdamW, Lion, and Muon, providing theoretical convergence guarantees for MGUP-AdamW and demonstrating superior or more stable performance in training large language models and MAE pretraining tasks.

arxiv arXiv cs.LG · 8d ago

SPHERE-JEPA: Family of Statistical Regularizers for Hypersphere

SPHERE-JEPA introduces deterministic statistical regularizers on the hypersphere, replacing stochastic sliced methods with analytically integrated objectives like MMD, KSD, and KL divergence. Rotationally invariant kernels based on heat and bandlimited filters ensure spatial bias-free learning, with empirical results showing improved convergence and performance on ImageNet and Galaxy10, and superior instance separation in procedural texture retrieval using KL divergence.

arxiv arXiv cs.LG · 8d ago

Confusion-Aware Transfer Teacher Curriculum Learning Framework

A confusion-aware difficulty score is introduced within the Transfer Teacher framework to improve model interpretability and data efficiency. Evaluations on CIFAR-10 show that confusion-aware curriculum ordering outperforms random ordering by up to 8.7% at 20% data, demonstrating consistent data-efficiency gains. However, curriculum or anti-curriculum ordering does not improve accuracy over standard training at full data, indicating that scoring function improvements alone are insufficient to overcome curriculum learning failure modes.

arxiv arXiv cs.LG · 8d ago

Blind Recovery of Latent Domains via Unsupervised Symmetry Discovery

The paper proposes an unsupervised framework to recover latent domains and signals from corrupted observations by discovering data symmetries. It models observations as linear measurements of signals from a latent random field and uses a shallow group-convolutional network with stationarity and locality constraints to learn latent symmetry actions and filters, enabling recovery from unstructured data.

arxiv arXiv cs.LG · 8d ago

Meta-classification of one-class models via ranking and nearest neighbor

This paper proposes a meta-classification method for one-class classification models by representing them as normality rankings and using ranking correlation and nearest neighbor metrics. The approach achieves high accuracy in classifying models based on training datasets, algorithms, and hyperparameters, and works even when datasets share the same class. The method effectively classifies datasets by treating multiple samples as a single input, offering a unified solution for OCC models, datasets, and rankings.

arxiv arXiv cs.LG · 8d ago

McWC: Forecasting with Cyclicity, Trend, and Channel Correlation

McWC introduces a model that separately captures cyclicity, trend, and inter-channel correlations in long-term time series forecasting. It uses multi-layer cyclicity construction, wavelet decomposition, and a multi-layer perceptron to extract and fuse high- and low-frequency information, while decoupling intra-channel autocorrelations via frequency-domain loss. Experiments on six real-world datasets show McWC achieves state-of-the-art performance with high computational efficiency.