Archives AI News

NeuroRVQ: Multi-Scale EEG Tokenization for Generative Large Brainwave Models

arXiv:2510.13068v2 Announce Type: replace Abstract: Electroencephalography (EEG) captures neural activity across multiple temporal and spectral scales, yielding signals that are rich but complex for representation learning. Recently, EEG foundation models trained to predict masked signal-tokens have shown promise for learning…

PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation

arXiv:2504.18583v4 Announce Type: replace Abstract: The autoregressive nature of large language models (LLMs) fundamentally limits inference speed, as each forward pass generates only a single token and is often bottlenecked by memory bandwidth. Speculative decoding has emerged as a promising…

Self-Supervised Dynamical System Representations for Physiological Time-Series

arXiv:2512.00239v1 Announce Type: new Abstract: The effectiveness of self-supervised learning (SSL) for physiological time series depends on the ability of a pretraining objective to preserve information about the underlying physiological state while filtering out unrelated noise. However, existing strategies are…

Constructing Efficient Fact-Storing MLPs for Transformers

arXiv:2512.00207v1 Announce Type: new Abstract: The success of large language models (LLMs) can be attributed in part to their ability to efficiently store factual knowledge as key-value mappings within their MLP parameters. Recent work has proposed explicit weight constructions to…