Archives AI News

Why and How Auxiliary Tasks Improve JEPA Representations

arXiv:2509.12249v1 Announce Type: new Abstract: Joint-Embedding Predictive Architecture (JEPA) is increasingly used for visual representation learning and as a component in model-based RL, but its behavior remains poorly understood. We provide a theoretical characterization of a simple, practical JEPA variant…

Optimization of GNN Training Through Half-precision

arXiv:2411.01109v2 Announce Type: replace Abstract: Recent trends in lower precision, e.g. half-precision floating point, training have shown improved system performance and reduced memory usage for Deep Learning while maintaining accuracy. However, current GNN systems cannot achieve such goals for GNN,…

Neural Diffeomorphic-Neural Operator for Residual Stress-Induced Deformation Prediction

arXiv:2509.12237v1 Announce Type: new Abstract: Accurate prediction of machining deformation in structural components is essential for ensuring dimensional precision and reliability. Such deformation often originates from residual stress fields, whose distribution and influence vary significantly with geometric complexity. Conventional numerical…

BATR-FST: Bi-Level Adaptive Token Refinement for Few-Shot Transformers

arXiv:2509.12768v1 Announce Type: cross Abstract: Vision Transformers (ViTs) have shown significant promise in computer vision applications. However, their performance in few-shot learning is limited by challenges in refining token-level interactions, struggling with limited training data, and developing a strong inductive…

RL Fine-Tuning Heals OOD Forgetting in SFT

arXiv:2509.12235v1 Announce Type: new Abstract: The two-stage fine-tuning paradigm of Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) has empirically shown better reasoning performance than one-stage SFT for the post-training of Large Language Models (LLMs). However, the evolution and mechanism…