Archives AI News

Why Retrying Fails: Context Contamination in LLM Agent Pipelines

arXiv:2605.08563v1 Announce Type: new Abstract: When an LLM agent fails a multi-step tool-augmented task and retries, the failed attempt typically remains in its context window — contaminating the next attempt and elevating the per-step error rate beyond the base level.…

The Power of Order: Fooling LLMs with Adversarial Table Permutations

arXiv:2605.00445v3 Announce Type: replace Abstract: Large Language Models have achieved remarkable success and are increasingly deployed in critical applications involving tabular data, such as Table Question Answering. However, their robustness to the structure of this input remains a critical, unaddressed…

MIDUS: Memory-Infused Depth Up-Scaling

arXiv:2512.13751v2 Announce Type: replace Abstract: Expanding pre-trained language models offers a practical way to increase capacity without training larger models from scratch. Depth Up-Scaling (DUS) does so by duplicating Transformer blocks and inserting them into a pre-trained backbone. This process…

Metropolis-Adjusted Diffusion Models

arXiv:2605.09654v1 Announce Type: cross Abstract: Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted…

Affine Tracing: A New Paradigm for Probabilistic Linear Solvers

arXiv:2605.10566v1 Announce Type: cross Abstract: Probabilistic linear solvers (PLSs) return probability distributions that quantify uncertainty due to limited computation in the solution of linear systems. The literature has traditionally distinguished between Bayesian PLSs, which condition a prior on information obtained…