RT-Transformer: The Transformer Block as a Spherical State Estimator
arXiv:2605.11007v1 Announce Type: new Abstract: We show that the core components of the Transformer block — attention, residual connections, and normalization — arise naturally from a single geometric estimation problem. Modeling the latent state as a direction on the hypersphere,…
