Archives AI News

Sliced Inner Product Gromov-Wasserstein Distances

arXiv:2605.08546v1 Announce Type: cross Abstract: The Gromov-Wasserstein (GW) problem provides a framework for aligning heterogeneous datasets by matching their intrinsic geometry, but its statistical and computational scaling remains an issue for high-dimensional problems. Slicing techniques offer an appealing route to…

Mixture-of-Top-k Attention: Efficient Attention via Scalable Fast Weights

arXiv:2602.01219v5 Announce Type: replace Abstract: The vanilla self-attention mechanism in Transformers can be viewed as a two-layer fast-weight MLP, whose weights are dynamically induced by inputs and whose hidden dimension is equal to the sequence length $N$. As the context…

The Power of Order: Fooling LLMs with Adversarial Table Permutations

arXiv:2605.00445v3 Announce Type: replace Abstract: Large Language Models have achieved remarkable success and are increasingly deployed in critical applications involving tabular data, such as Table Question Answering. However, their robustness to the structure of this input remains a critical, unaddressed…

MIDUS: Memory-Infused Depth Up-Scaling

arXiv:2512.13751v2 Announce Type: replace Abstract: Expanding pre-trained language models offers a practical way to increase capacity without training larger models from scratch. Depth Up-Scaling (DUS) does so by duplicating Transformer blocks and inserting them into a pre-trained backbone. This process…

Metropolis-Adjusted Diffusion Models

arXiv:2605.09654v1 Announce Type: cross Abstract: Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted…