Archives AI News

Self-Supervised Dynamical System Representations for Physiological Time-Series

arXiv:2512.00239v1 Announce Type: new Abstract: The effectiveness of self-supervised learning (SSL) for physiological time series depends on the ability of a pretraining objective to preserve information about the underlying physiological state while filtering out unrelated noise. However, existing strategies are…

Constructing Efficient Fact-Storing MLPs for Transformers

arXiv:2512.00207v1 Announce Type: new Abstract: The success of large language models (LLMs) can be attributed in part to their ability to efficiently store factual knowledge as key-value mappings within their MLP parameters. Recent work has proposed explicit weight constructions to…

Orion-Bix: Bi-Axial Attention for Tabular In-Context Learning

arXiv:2512.00181v1 Announce Type: new Abstract: Tabular data drive most real-world machine learning applications, yet building general-purpose models for them remains difficult. Mixed numeric and categorical fields, weak feature structure, and limited labeled data make scaling and generalization challenging. To this…

We Still Don’t Understand High-Dimensional Bayesian Optimization

arXiv:2512.00170v1 Announce Type: new Abstract: High-dimensional spaces have challenged Bayesian optimization (BO). Existing methods aim to overcome this so-called curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly, we demonstrate…

A CPU-Centric Perspective on Agentic AI

arXiv:2511.00739v2 Announce Type: replace-cross Abstract: Agentic AI frameworks add a decision-making orchestrator embedded with external tools, including web search, Python interpreter, contextual database, and others, on top of monolithic LLMs, turning them from passive text oracles into autonomous problem-solvers that…

Real-World Reinforcement Learning of Active Perception Behaviors

arXiv:2512.01188v1 Announce Type: cross Abstract: A robot’s instantaneous sensory observations do not always reveal task-relevant state information. Under such partial observability, optimal behavior typically involves explicitly acting to gain the missing information. Today’s standard robot learning techniques struggle to produce…