Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
arXiv:2509.10439v1 Announce Type: cross Abstract: Modern machine learning often requires training with large batch size, distributed data, and massively parallel compute hardware (like mobile and other edge devices or distributed data centers). Communication becomes a major bottleneck in such settings…
