Archives AI News

Characterizing Universal Object Representations Across Vision Models

arXiv:2605.13675v1 Announce Type: cross Abstract: Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and which factors may…

Scaling Laws for Mixture Pretraining Under Data Constraints

arXiv:2605.12715v1 Announce Type: new Abstract: As language models scale, the amount of data they require grows — yet many target data sources, such as low-resource languages or specialized domains, are inherently limited in size. A common strategy is to mix…

Latent-Augmented Discrete Diffusion Models

arXiv:2510.18114v3 Announce Type: replace Abstract: Discrete diffusion models have emerged as a powerful class of models and a promising route to fast language generation, but practical implementations typically rely on factored reverse transitions ignoring cross-token dependencies and degrading few-step performance.…

Before the Last Token: Diagnosing Final-Token Safety Probe Failures

arXiv:2605.12726v1 Announce Type: new Abstract: Final-token safety probes monitor a single hidden state after prompt prefill, but jailbreak prompts can contain probe-visible unsafe evidence distributed across earlier user-token representations that is missed by this readout. We study this prefill-time failure…