Archives AI News

Adaptive Preconditioners Trigger Loss Spikes in Adam

arXiv:2506.04805v2 Announce Type: replace Abstract: Loss spikes commonly emerge during neural network training with the Adam optimizer across diverse architectures and scales, yet their underlying mechanism remains elusive. While previous explanations attribute these phenomena to sharper loss landscapes at lower…

Byzantine-Robust Federated Learning with Learnable Aggregation Weights

arXiv:2511.03529v2 Announce Type: replace Abstract: Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly when data distributions…