Archives AI News

Constructing Efficient Fact-Storing MLPs for Transformers

arXiv:2512.00207v1 Announce Type: new Abstract: The success of large language models (LLMs) can be attributed in part to their ability to efficiently store factual knowledge as key-value mappings within their MLP parameters. Recent work has proposed explicit weight constructions to…

Discrete Optimal Transport and Voice Conversion

arXiv:2505.04382v3 Announce Type: replace-cross Abstract: In this work, we address the voice conversion (VC) task using a vector-based interface. To align audio embeddings between speakers, we employ discrete optimal transport mapping. Our evaluation results demonstrate the high quality and effectiveness…

NeuroRVQ: Multi-Scale EEG Tokenization for Generative Large Brainwave Models

arXiv:2510.13068v2 Announce Type: replace Abstract: Electroencephalography (EEG) captures neural activity across multiple temporal and spectral scales, yielding signals that are rich but complex for representation learning. Recently, EEG foundation models trained to predict masked signal-tokens have shown promise for learning…

PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation

arXiv:2504.18583v4 Announce Type: replace Abstract: The autoregressive nature of large language models (LLMs) fundamentally limits inference speed, as each forward pass generates only a single token and is often bottlenecked by memory bandwidth. Speculative decoding has emerged as a promising…