Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
arXiv:2503.00229v4 Announce Type: replace Abstract: Armijo line-search (Armijo-LS) is a standard method to set the step-size for gradient descent (GD). For smooth functions, Armijo-LS alleviates the need to know the global smoothness constant L and adapts to the “local” smoothness,…
