HeadQ: Model-Visible Distortion and Score-Space Correction for KV-Cache Quantization
arXiv:2605.03562v3 Announce Type: replace Abstract: KV-cache quantizers usually optimize storage-space reconstruction, even though attention reads keys through logits and values through attention-weighted readout. We argue that persistent cache error should be measured in model-visible coordinates. For keys, the visible object…
