Towards Scalable Backpropagation-Free Gradient Estimation
arXiv:2511.03110v1 Announce Type: new Abstract: While backpropagation–reverse-mode automatic differentiation–has been extraordinarily successful in deep learning, it requires two passes (forward and backward) through the neural network and the storage of intermediate activations. Existing gradient estimation methods that instead use forward-mode…
