Archives AI News

A Predictive Approach To Enhance Time-Series Forecasting

arXiv:2410.15217v3 Announce Type: replace Abstract: Accurate time-series forecasting is crucial in various scientific and industrial domains, yet deep learning models often struggle to capture long-term dependencies and adapt to data distribution shifts over time. We introduce Future-Guided Learning, an approach…

Communication-Efficient and Interoperable Distributed Learning

arXiv:2509.22823v1 Announce Type: new Abstract: Collaborative learning across heterogeneous model architectures presents significant challenges in ensuring interoperability and preserving privacy. We propose a communication-efficient distributed learning framework that supports model heterogeneity and enables modular composition during inference. To facilitate interoperability,…

On the Capacity of Self-Attention

arXiv:2509.22840v1 Announce Type: new Abstract: While self-attention is known to learn relations among tokens, we lack a formal understanding of its capacity: how many distinct relations can a single layer reliably recover for a given budget? To formalize this, we…

Observation-Free Attacks on Online Learning to Rank

arXiv:2509.22855v1 Announce Type: new Abstract: Online learning to rank (OLTR) plays a critical role in information retrieval and machine learning systems, with a wide range of applications in search engines and content recommenders. However, despite their extensive adoption, the susceptibility…

Adaptive Margin RLHF via Preference over Preferences

arXiv:2509.22851v1 Announce Type: new Abstract: Margin-based optimization is fundamental to improving generalization and robustness in classification tasks. In the context of reward model learning from preferences within Reinforcement Learning from Human Feedback (RLHF), existing methods typically rely on no margins,…

Meta-Learning to Explore via Memory Density Feedback

arXiv:2503.02831v2 Announce Type: replace Abstract: Exploration algorithms for reinforcement learning typically replace or augment the reward function with an additional “intrinsic” reward that trains the agent to seek previously unseen states of the environment. Here, we consider an exploration algorithm…

Neighborhood Sampling Does Not Learn the Same Graph Neural Network

arXiv:2509.22868v1 Announce Type: new Abstract: Neighborhood sampling is an important ingredient in the training of large-scale graph neural networks. It suppresses the exponential growth of the neighborhood size across network layers and maintains feasible memory consumption and time costs. While…

Type-Compliant Adaptation Cascades: Adapting Programmatic LM Workflows to Data

arXiv:2508.18244v2 Announce Type: replace Abstract: Reliably composing Large Language Models (LLMs) for complex, multi-step workflows remains a significant challenge. The dominant paradigm — optimizing discrete prompts in a pipeline — is notoriously brittle and struggles to enforce the formal compliance…