Archives AI News

Sparse Polyak: an adaptive step size rule for high-dimensional M-estimation

arXiv:2509.09802v1 Announce Type: cross Abstract: We propose and study Sparse Polyak, a variant of Polyak’s adaptive step size, designed to solve high-dimensional statistical estimation problems where the problem dimension is allowed to grow much faster than the sample size. In…

Sufficient Invariant Learning for Distribution Shift

arXiv:2210.13533v4 Announce Type: replace-cross Abstract: Learning robust models under distribution shifts between training and test datasets is a fundamental challenge in machine learning. While learning invariant features across environments is a popular approach, it often assumes that these features are…

A Computable Measure of Suboptimality for Entropy-Regularised Variational Objectives

arXiv:2509.10393v1 Announce Type: cross Abstract: Several emerging post-Bayesian methods target a probability distribution for which an entropy-regularised variational objective is minimised. This increased flexibility introduces a computational challenge, as one loses access to an explicit unnormalised density for the target.…

On Regression in Extreme Regions

arXiv:2303.03084v3 Announce Type: replace Abstract: We establish a statistical learning theoretical framework aimed at extrapolation, or out-of-domain generalization, on the unobserved tails of covariates in continuous regression problems. Our strategy involves performing statistical regression on a subsample of observations with…

Simulation-based Inference via Langevin Dynamics with Score Matching

arXiv:2509.03853v2 Announce Type: replace-cross Abstract: Simulation-based inference (SBI) enables Bayesian analysis when the likelihood is intractable but model simulations are available. Recent advances in statistics and machine learning, including Approximate Bayesian Computation and deep generative models, have expanded the applicability…

Soft Diamond Regularizers for Deep Learning

arXiv:2412.20724v2 Announce Type: replace Abstract: This chapter presents the new family of soft diamond synaptic regularizers based on thick-tailed symmetric alpha stable $S{alpha}S$ probability bell curves. These new parametrized weight priors improved deep-learning performance on image and language-translation test sets…