Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
arXiv:2512.22192v1 Announce Type: new Abstract: Regularization techniques such as L2 regularization (Weight Decay) and Dropout are fundamental to training deep neural networks, yet their underlying physical mechanisms regarding feature frequency selection remain poorly understood. In this work, we investigate the…
