Exploring Expert Specialization through Unsupervised Training in Sparse Mixture of Experts
arXiv:2509.10025v1 Announce Type: new Abstract: Understanding the internal organization of neural networks remains a fundamental challenge in deep learning interpretability. We address this challenge by exploring a novel Sparse Mixture of Experts Variational Autoencoder (SMoE-VAE) architecture. We test our model…
