Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity
arXiv:2510.01171v2 Announce Type: replace-cross Abstract: Post-training alignment often reduces LLM diversity, leading to a phenomenon known as mode collapse. Unlike prior work that attributes this effect to algorithmic limitations, we identify a fundamental, pervasive data-level driver: typicality bias in preference…
