Archives AI News

Semi-Supervised Preference Optimization with Limited Feedback

arXiv:2511.00040v1 Announce Type: new Abstract: The field of preference optimization has made outstanding contributions to the alignment of language models with human preferences. Despite these advancements, recent methods still rely heavily on substantial paired (labeled) feedback data, leading to substantial…

Probing Knowledge Holes in Unlearned LLMs

arXiv:2511.00030v1 Announce Type: new Abstract: Machine unlearning has emerged as a prevalent technical solution for selectively removing unwanted knowledge absorbed during pre-training, without requiring full retraining. While recent unlearning techniques can effectively remove undesirable content without severely compromising performance on…

Evaluation and Optimization of Leave-one-out Cross-validation for the Lasso

arXiv:2508.14368v2 Announce Type: replace-cross Abstract: I develop an algorithm to produce the piecewise quadratic that computes leave-one-out cross-validation for the lasso as a function of its hyperparameter. The algorithm can be used to find exact hyperparameters that optimize leave-one-out cross-validation…

Scientific Machine Learning with Kolmogorov-Arnold Networks

arXiv:2507.22959v2 Announce Type: replace Abstract: The field of scientific machine learning, which originally utilized multilayer perceptrons (MLPs), is increasingly adopting Kolmogorov-Arnold Networks (KANs) for data encoding. This shift is driven by the limitations of MLPs, including poor interpretability, fixed activation…