All articles
arxiv arXiv cs.LG · 7h ago

Lightweight Transformer Models for On-Device Fault Detection: A Benchmark Study on Resource-Constrained Deployment

This study benchmarks traditional machine learning methods against lightweight transformer architectures for binary fault detection across three public datasets, evaluating tradeoffs between accuracy, model size, and latency. The research assesses classification performance using F1-score and AUC, while also testing INT8 dynamic quantization and a two-stage adaptive inference pipeline to optimize deployment on resource-constrained hardware.

arxiv arXiv cs.LG · 8h ago

MotifGen: Spatiotemporal interpolation of misaligned satellite images via multi-source generative modeling

Researchers introduce MotifGen, a generative model designed for the spatiotemporal interpolation of tropical cyclone microwave images from multiple geospatial sources with irregular time intervals and geographic misalignment. The model addresses the challenge of high heterogeneity in microwave data by combining inputs from various instruments to fill gaps caused by long satellite revisit times.

arxiv arXiv cs.LG · 8h ago

Managing Task Execution for Unknown Workloads in Batteryless IoT: A Hardware-Agnostic Evaluation

This study proposes two hardware-agnostic dynamic scheduling strategies, a model-free Reinforcement Learning agent and an on-the-fly Approximated Prediction method, to manage volatile energy in batteryless IoT systems without prior task profiles. Evaluated against adaptive and static baselines using a custom simulation framework, the research highlights distinct operational trade-offs for different system constraints.

arxiv arXiv cs.LG · 8h ago

Parallel Manifold Steering: Efficient Adaptation of Large Associative Memories via Residual Energy Shaping

The authors propose H-Res (Hierarchical Residual Steering), a mechanism that adapts large Transformer models by modulating their effective energy landscape without altering global equilibrium or expanding sequence length. This approach formulates adaptation as a control problem on the activation manifold to steer token trajectories into task-specific basins of attraction.