Archives AI News

The Limits of Inference Scaling Through Resampling

arXiv:2411.17501v3 Announce Type: replace Abstract: Recent research has generated hope that inference scaling, such as resampling solutions until they pass verifiers like unit tests, could allow weaker models to match stronger ones. Beyond inference, this approach also enables training reasoning…

Contrastive Learning Boosts Deterministic and Generative Models for Weather Data

arXiv:2603.24744v1 Announce Type: new Abstract: Weather data, comprising multiple variables, poses significant challenges due to its high dimensionality and multimodal nature. Creating low-dimensional embeddings requires compressing this data into a compact, shared latent space. This compression is required to improve…

Grokking as a Falsifiable Finite-Size Transition

arXiv:2603.24746v1 Announce Type: new Abstract: Grokking — the delayed onset of generalization after early memorization — is often described with phase-transition language, but that claim has lacked falsifiable finite-size inputs. Here we supply those inputs by treating the group order…

Light Cones For Vision: Simple Causal Priors For Visual Hierarchy

arXiv:2603.24753v1 Announce Type: new Abstract: Standard vision models treat objects as independent points in Euclidean space, unable to capture hierarchical structure like parts within wholes. We introduce Worldline Slot Attention, which models objects as persistent trajectories through spacetime worldlines, where…