Archives AI News

Asymmetric Advantage Modulation Calibrates Entropy Dynamics in RLVR

arXiv:2604.04894v2 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning ability of large language models (LLMs), but it often suffers from textit{restricted exploration}, where the policy rapidly concentrates on a narrow set of solutions.…

RT-Transformer: The Transformer Block as a Spherical State Estimator

arXiv:2605.11007v1 Announce Type: new Abstract: We show that the core components of the Transformer block — attention, residual connections, and normalization — arise naturally from a single geometric estimation problem. Modeling the latent state as a direction on the hypersphere,…

The Evaluation Differential: When Frontier AI Models Recognise They Are Being Tested

arXiv:2605.11496v1 Announce Type: cross Abstract: Recent published evidence from frontier laboratories shows that contemporary AI models can recognise evaluation contexts, latently represent them, and behave differently under those contexts than under deployment-continuous conditions. Anthropic’s BrowseComp incident, the Natural Language Autoencoder…

When and How to Canonize: A Generalization Perspective

arXiv:2605.11008v1 Announce Type: new Abstract: While invariant architectures are standard for processing symmetric data, there is growing interest in achieving invariance by applying group averaging or canonization to non-invariant backbones. However, the theoretical generalization properties of these alternative strategies remain…

ACSAC: Adaptive Chunk Size Actor-Critic with Causal Transformer Q-Network

arXiv:2605.11009v1 Announce Type: new Abstract: Long-horizon, sparse-reward tasks pose a fundamental challenge for reinforcement learning, since single-step TD learning suffers from bootstrapping error accumulation across successive Bellman updates. Actor-critic methods with action chunking address this by operating over temporally extended…