Archives AI News

All Optical Echo State Network Reservoir Computing

arXiv:2504.08224v2 Announce Type: replace-cross Abstract: We propose an innovative design for an all-optical Echo State Network (ESN), an advanced type of reservoir computer known for its universal computational capabilities. Our design enables fully optical implementation of arbitrary ESNs, featuring flexibility…

MMM: Clustering Multivariate Longitudinal Mixed-type Data

arXiv:2509.12166v1 Announce Type: new Abstract: Multivariate longitudinal data of mixed-type are increasingly collected in many science domains. However, algorithms to cluster this kind of data remain scarce, due to the challenge to simultaneously model the within- and between-time dependence structures…

Early alignment in two-layer networks training is a two-edged sword

arXiv:2401.10791v3 Announce Type: replace-cross Abstract: Training neural networks with first order optimisation methods is at the core of the empirical success of deep learning. The scale of initialisation is a crucial factor, as small initialisations are generally associated to a…

Non-Linear Model-Based Sequential Decision-Making in Agriculture

arXiv:2509.01924v2 Announce Type: replace Abstract: Sequential decision-making is central to sustainable agricultural management and precision agriculture, where resource inputs must be optimized under uncertainty and over time. However, such decisions must often be made with limited observations, whereas classical bandit…

SpaPool: Soft Partition Assignment Pooling for__Graph Neural Networks

arXiv:2509.11675v1 Announce Type: new Abstract: This paper introduces SpaPool, a novel pooling method that combines the strengths of both dense and sparse techniques for a graph neural network. SpaPool groups vertices into an adaptive number of clusters, leveraging the benefits…

Deep learning joint extremes of metocean variables using the SPAR model

arXiv:2412.15808v3 Announce Type: replace Abstract: This paper presents a novel deep learning framework for estimating multivariate joint extremes of metocean variables, based on the Semi-Parametric Angular-Radial (SPAR) model. When considered in polar coordinates, the problem of modelling multivariate extremes is…

Piecewise Deterministic Markov Processes for Bayesian Neural Networks

arXiv:2302.08724v3 Announce Type: replace Abstract: Inference on modern Bayesian Neural Networks (BNNs) often relies on a variational inference treatment, imposing violated assumptions of independence and the form of the posterior. Traditional MCMC approaches avoid these assumptions at the cost of…

Predictable Compression Failures: Why Language Models Actually Hallucinate

arXiv:2509.11208v1 Announce Type: new Abstract: Large language models perform near-Bayesian inference yet violate permutation invariance on exchangeable data. We resolve this by showing transformers minimize expected conditional description length (cross-entropy) over orderings, $mathbb{E}_pi[ell(Y mid Gamma_pi(X))]$, which admits a Kolmogorov-complexity interpretation…

Contrastive Network Representation Learning

arXiv:2509.11316v1 Announce Type: new Abstract: Network representation learning seeks to embed networks into a low-dimensional space while preserving the structural and semantic properties, thereby facilitating downstream tasks such as classification, trait prediction, edge identification, and community detection. Motivated by challenges…