Archives AI News

Rethinking Local Learning: A Cheaper and Faster Recipe for LLM Post-Training

arXiv:2605.04913v4 Announce Type: replace-cross Abstract: LLM post-training typically propagates task gradients through the full depth of the model. Although this end-to-end structure is simple and general, it couples task adaptation to full-depth activation storage, long-range backward dependencies and direct task-gradient…

From A to B to A: Palindromic Zero-Shot Voice Conversion with Non-Parallel Data

arXiv:2606.08843v1 Announce Type: cross Abstract: We present a voice conversion (VC) framework that utilizes K-Nearest Neighbors (KNN) retrieval over WavLM representations to align non-parallel source and target speech, constructing synthetic training pairs for supervised learning. The retrieved segments serve as…

Post-Trained MoE Can Skip Half Experts via Self-Distillation

arXiv:2605.18643v2 Announce Type: replace Abstract: Mixture-of-Experts (MoE) scales language models efficiently through sparse expert activation, and its dynamic variant further reduces computation by adjusting the activated experts in an input-dependent manner. Existing dynamic MoE methods usually rely on pre-training from…

Enabling KV Caching of Shared Prefix for Diffusion Language Models

arXiv:2606.07571v1 Announce Type: new Abstract: Key-value (KV) caching for shared prefixes is essential for high-throughput large language model (LLM) serving, but it faces critical challenges in emerging diffusion language models (DLMs). In DLMs, bidirectional attention means that updating any token…