Archives AI News

Modeling AdaGrad, RMSProp, and Adam with Integro-Differential Equations

arXiv:2411.09734v3 Announce Type: replace Abstract: In this paper, we propose a continuous-time formulation for the AdaGrad, RMSProp, and Adam optimization algorithms by modeling them as first-order integro-differential equations. We perform numerical simulations of these equations, along with stability and convergence…

Learn to Match: Two-Sided Matching with Temporally Extended Feedback

arXiv:2606.06744v1 Announce Type: new Abstract: Two-sided matching markets often involve information that unfolds over time through interviews, repeated interaction, learning, and separation. Existing matching models typically reduce this process to immediate sub-Gaussian feedback about fixed preferences, missing settings where payoff-relevant…

Performance Variation in Deep Reinforcement Learning

arXiv:2606.06746v1 Announce Type: new Abstract: Deep reinforcement learning (RL) algorithms often suffer from low run-to-run robustness, manifesting as significant performance variation across independent runs of identically configured agents. Although this issue poses a spectrum of challenges across research and practice,…

RePo: Language Models with Context Re-Positioning

arXiv:2512.14391v3 Announce Type: replace Abstract: In-context learning is fundamental to modern Large Language Models (LLMs); however, prevailing architectures impose a rigid and fixed contextual structure by assigning linear or constant positional indices. The rigid position information poses the full burden…

On the conditional equivalence of phase retrieval algorithms

arXiv:2606.07257v1 Announce Type: cross Abstract: Phase retrieval – recovering a complex-valued field from intensity measurements – is typically solved using variants of the Gerchberg-Saxton (GS) algorithm, understood as alternating projections between measurement planes. Meanwhile, modern computational imaging increasingly relies on…