From n-gram to Attention: How Model Architectures Learn and Propagate Bias in Language Modeling
arXiv:2505.12381v2 Announce Type: replace-cross Abstract: Current research on bias in language models (LMs) predominantly focuses on data quality, with significantly less attention paid to model architecture and temporal influences of data. Even more critically, few studies systematically investigate the origins…
