arXiv — stat.ML

A recent study published on arXiv investigates transfer learning for linear discriminant analysis (LDA) in high-dimensional two-class classification, focusing on a target domain and multiple source domains. The research decomposes mean differences into a common component and domain-specific deviations, deriving limits for transfer classifiers' performance under various covariance settings.

A new paper introduces sigTPP, a generative model for Temporal Point Processes (TPPs) that utilizes rough path signatures to extend signature methods to discrete event sequences. This approach addresses limitations in existing neural TPP models, which optimize per-event objectives without a global sequence-level loss. The proposed interarrival embedding offers a stable transition from jump paths to continuous paths of bounded variation.

A recent study presents a novel approach to spectral positional encodings (PEs) for directed graphs, addressing challenges posed by magnetic Laplacians and the need for Hermitian eigendecomposition. The proposed method utilizes learnable spectral PEs that are gauge-invariant by construction, computed through Hermitian block Krylov subspaces, thus enhancing efficiency in graph representation.

A new algorithm has been developed to operationalize individual fairness in algorithmic decision-making, focusing on learning a Mahalanobis similarity metric through triplet queries. This approach utilizes the Bradley-Terry model for pairwise comparisons and incorporates a spectral initialization step followed by gradient descent to ensure rapid convergence to the true metric.

A recent study published on arXiv has established that in the realizable PAC setting, the sample complexity for exact-trace learning of full autoregressive Chain-of-Thought traces is limited by the multiclass rate of the local next-token class, influenced by the Daniely--Shalev-Shwartz dimension. The findings indicate that under exact-trace loss, a single incorrect action can invalidate the entire trace, yet the sample complexity remains manageable regardless of rollout length.

A new unified detection framework for artificial intelligence (AI)-related content and artifacts has been proposed, utilizing Mahalanobis distance scores (MDS) to identify various AI-generated outputs, including text from large language models (LLMs) and adversarial examples. This framework aims to enhance oversight and regulation in AI deployment.

A recent study published on arXiv investigates the high-dimensional training dynamics of shallow neural networks with quadratic activation in a teacher-student setup, focusing on the extensive-width regime where network widths scale with input dimensions. The research derives a dynamical characterization of gradient flow, revealing insights into overparameterization's effects on learning and generalization, particularly under l2-regularization.

A new diffusion framework named DiPhon has been introduced for scalable graph generation, utilizing graphons to study structural graph statistics across varying node sizes. This approach addresses the challenge of scaling diffusion models to large graphs, particularly in dense-graph settings, by formulating a continuous diffusion process based on Jacobi stochastic differential equations.

A recent study has introduced tensorized algorithms and scalable filtering methods for hidden Markov models (HMM) and factorial hidden Markov models (fHMM), addressing the computational challenges associated with time-series data analysis. This research highlights the limitations of traditional HMMs when dealing with complex systems influenced by multiple independent factors, which fHMMs can better represent.

A recent study published on arXiv presents advancements in fixed-bandwidth Gaussian kernel spectral algorithms, focusing on establishing minimax optimal convergence rates in nonparametric regression settings and enhancing transfer learning under concept shift. The findings indicate that these algorithms can achieve optimal rates even when the model is misspecified, provided the regularization parameter decays exponentially.

A recent study published on arXiv addresses the challenge of finding stationary points in stochastic convex optimization problems, emphasizing the need for a stronger criterion than traditional methods. The research highlights that the subdifferential of the objective must contain a small element, which is significant due to the non-uniform convergence of subdifferentials in convex functions.

A novel approach called Tensor Train Diffusion has been introduced, focusing on leveraging low-rank structures to enhance high-dimensional score-based sampling. This method addresses the challenges of existing techniques in solving Hamilton-Jacobi-Bellman equations, which are critical for understanding complex probability densities in diffusion models.