Archives AI News

Measuring the Representational Alignment of Neural Systems in Superposition

arXiv:2604.00208v1 Announce Type: new Abstract: Comparing the internal representations of neural networks is a central goal in both neuroscience and machine learning. Standard alignment metrics operate on raw neural activations, implicitly assuming that similar representations produce similar activity patterns. However,…

Rapid mixing in positively weighted restricted Boltzmann machines

arXiv:2604.00963v1 Announce Type: cross Abstract: We show polylogarithmic mixing time bounds for the alternating-scan sampler for positively weighted restricted Boltzmann machines. This is done via analysing the same chain and the Glauber dynamics for ferromagnetic two-spin systems, where we obtain…

Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning

arXiv:2603.09697v2 Announce Type: replace Abstract: Recent advances in spectral optimization, notably Muon, have demonstrated that constraining update steps to the Stiefel manifold can significantly accelerate training and improve generalization. However, Muon implicitly assumes an isotropic optimization landscape, enforcing a uniform…