Archives AI News

Two Stage Wireless Federated LoRA Fine-Tuning with Sparsified Orthogonal Updates

arXiv:2505.00333v2 Announce Type: replace Abstract: Transformer-based large language models (LLMs) have achieved remarkable success across various tasks. Yet, fine-tuning such massive models in federated learning (FL) settings poses significant challenges due to resource constraints and communication overhead. Low-Rank Adaptation (LoRA)…

Beyond the Mean: Distribution-Aware Loss Functions for Bimodal Regression

arXiv:2603.22328v1 Announce Type: new Abstract: Despite the strong predictive performance achieved by machine learning models across many application domains, assessing their trustworthiness through reliable estimates of predictive confidence remains a critical challenge. This issue arises in scenarios where the likelihood…

Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency

arXiv:2406.07598v5 Announce Type: replace Abstract: We consider achieving equivariance in machine learning systems via frame averaging. Current frame averaging methods involve a costly sum over large frames or rely on sampling-based approaches that only yield approximate equivariance. Here, we propose…