MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models
arXiv:2603.16077v3 Announce Type: replace Abstract: Masked diffusion models (MDM) exhibit superior generalization when learned using a Partial masking scheme (Prime). This approach converts tokens into sub-tokens and models the diffusion process at the sub-token level. We identify two limitations of…
