Symmetry in language statistics shapes the geometry of model representations
arXiv:2602.15029v2 Announce Type: replace Abstract: The internal representations learned by language models consistently exhibit striking geometric structure: calendar months organize into a circle, historical years form a smooth one-dimensional manifold, and cities’ latitudes and longitudes can be decoded using a…
