Archives AI News

Matryoshka Model Learning for Improved Elastic Student Models

arXiv:2505.23337v3 Announce Type: replace Abstract: Industry-grade ML models are carefully designed to meet rapidly evolving serving constraints, which requires significant resources for model development. In this paper, we propose MatTA, a framework for training multiple accurate Student models using a…

Retrieval-Augmented Memory for Online Learning

arXiv:2512.02333v1 Announce Type: new Abstract: Retrieval-augmented models couple parametric predictors with non-parametric memories, but their use in streaming supervised learning with concept drift is not well understood. We study online classification in non-stationary environments and propose Retrieval-Augmented Memory for Online…

Forecasting in Offline Reinforcement Learning for Non-stationary Environments

arXiv:2512.01987v2 Announce Type: replace Abstract: Offline Reinforcement Learning (RL) provides a promising avenue for training policies from pre-collected datasets when gathering additional interaction data is infeasible. However, existing offline RL methods often assume stationarity or only consider synthetic perturbations at…

Training a Scientific Reasoning Model for Chemistry

arXiv:2506.17238v2 Announce Type: replace Abstract: Reasoning models are large language models that emit a long chain-of-thought before answering, providing both higher accuracy and explicit reasoning for their response. A major question has been whether language model reasoning generalizes beyond mathematics,…