Archives AI News

An Efficient Classification Model for Cyber Text

arXiv:2511.03107v1 Announce Type: new Abstract: The uprising of deep learning methodology and practice in recent years has brought about a severe consequence of increasing carbon footprint due to the insatiable demand for computational resources and power. The field of text…

Composing Linear Layers from Irreducibles

arXiv:2507.11688v3 Announce Type: replace Abstract: Contemporary large models often exhibit behaviors suggesting the presence of low-level primitives that compose into modules with richer functionality, but these fundamental building blocks remain poorly understood. We investigate this compositional structure in linear layers…

Towards Scalable Backpropagation-Free Gradient Estimation

arXiv:2511.03110v1 Announce Type: new Abstract: While backpropagation–reverse-mode automatic differentiation–has been extraordinarily successful in deep learning, it requires two passes (forward and backward) through the neural network and the storage of intermediate activations. Existing gradient estimation methods that instead use forward-mode…

ReNF: Rethinking the Design Space of Neural Long-Term Time Series Forecasters

arXiv:2509.25914v4 Announce Type: replace Abstract: Neural Forecasters (NFs) are a cornerstone of Long-term Time Series Forecasting (LTSF). However, progress has been hampered by an overemphasis on architectural complexity at the expense of fundamental forecasting principles. In this work, we return…

An Augmentation Overlap Theory of Contrastive Learning

arXiv:2511.03114v1 Announce Type: new Abstract: Recently, self-supervised contrastive learning has achieved great success on various tasks. However, its underlying working mechanism is yet unclear. In this paper, we first provide the tightest bounds based on the widely adopted assumption of…

Q&A: How folk ballads explain the world

Ruth Perry’s new book profiles Anna Gordon, a Scotswoman who preserved and transmitted precious popular ballads, and with them national traditions.