Stochastic Parroting in Temporal Attention — Regulating the Diagonal Sink
arXiv:2602.10956v3 Announce Type: replace Abstract: Spatio-temporal models analyze spatial structures and temporal dynamics, which makes them prone to information degeneration among space and time. Prior literature has demonstrated that over-squashing in causal attention or temporal convolutions creates a bias on…
