Online Ensemble Learning for Sector Rotation: A Gradient-Free Framework

arXiv — stat.MLThursday, November 13, 2025 at 5:00:00 AM
The introduction of a gradient-free online ensemble learning algorithm marks a notable advancement in the field of machine learning, particularly for sector rotation strategies. This algorithm integrates forecasts from a diverse set of 16 models, including both linear benchmarks like OLS, PCR, and LASSO, as well as nonlinear learners such as Random Forests and Gradient-Boosted Trees. By adapting weights based on recent predictive performance, the ensemble consistently outperforms individual models and traditional offline ensembles. The empirical findings suggest that sector returns are more predictable and stable than those of individual assets, making this approach particularly suitable for cross-sectional forecasting. The theoretical framework provides a guarantee on forecast accuracy, bounding the online forecast regret in terms of realized out-of-sample R-squared. This development not only enhances predictive accuracy but also promises stronger risk-adjusted returns across various …
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended Readings
Compiling to linear neurons
PositiveArtificial Intelligence
The article discusses the limitations of programming neural networks directly, highlighting the reliance on indirect learning algorithms like gradient descent. It introduces Cajal, a new higher-order programming language designed to compile algorithms into linear neurons, thus enabling the expression of discrete algorithms in a differentiable manner. This advancement aims to enhance the capabilities of neural networks by overcoming the challenges posed by traditional programming methods.
Empirical Likelihood for Random Forests and Ensembles
NeutralArtificial Intelligence
An empirical likelihood (EL) framework for random forests and ensemble methods has been developed, offering a likelihood-based approach to quantify statistical uncertainty. This framework utilizes the incomplete U-statistic structure in ensemble predictions to create an EL statistic that is asymptotically chi-squared under certain conditions. A modified EL is proposed to address over-coverage issues in sparser subsampling regimes, ensuring computational efficiency while maintaining key properties of EL. Simulations indicate that this method achieves reliable coverage compared to existing infer…
Towards a Unified Analysis of Neural Networks in Nonparametric Instrumental Variable Regression: Optimization and Generalization
PositiveArtificial Intelligence
The study presents the first global convergence result for neural networks using a two-stage least squares (2SLS) approach in nonparametric instrumental variable regression (NPIV). By employing mean-field Langevin dynamics (MFLD) and addressing a bilevel optimization problem, the researchers introduce a novel first-order algorithm named F²BMLD. The findings include convergence and generalization bounds, highlighting a trade-off in the choice of Lagrange multipliers, and the method's effectiveness is validated through offline reinforcement learning experiments.
Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks
NeutralArtificial Intelligence
The article discusses the significance of hyperparameter tuning in ensuring the convergence of machine learning models, particularly through stochastic gradient descent (SGD). It presents a phase diagram of a multilayer neural network, where each phase reflects unique dynamics of singular values in weight matrices. The study draws parallels with disordered systems, interpreting the loss landscape as a disordered feature space, with the initial variance of weight matrices representing disorder strength and temperature linked to the learning rate and batch size.
Statistically controllable microstructure reconstruction framework for heterogeneous materials using sliced-Wasserstein metric and neural networks
PositiveArtificial Intelligence
A new framework for reconstructing the microstructure of heterogeneous porous materials has been proposed, integrating neural networks with the sliced-Wasserstein metric. This approach enhances microstructure characterization and reconstruction, which are essential for modeling materials in engineering applications. By utilizing local pattern distribution and a controlled sampling strategy, the framework aims to improve the controllability and applicability of microstructure reconstruction, even with small sample sizes.
SWAT-NN: Simultaneous Weights and Architecture Training for Neural Networks in a Latent Space
PositiveArtificial Intelligence
The paper presents SWAT-NN, a novel approach for optimizing neural networks by simultaneously training both their architecture and weights. Unlike traditional methods that rely on manual adjustments or discrete searches, SWAT-NN utilizes a multi-scale autoencoder to embed architectural and parametric information into a continuous latent space. This allows for efficient model optimization through gradient descent, incorporating penalties for sparsity and compactness to enhance model efficiency.
Networks with Finite VC Dimension: Pro and Contra
NeutralArtificial Intelligence
The article discusses the approximation and learning capabilities of neural networks concerning high-dimensional geometry and statistical learning theory. It examines the impact of the VC dimension on the networks' ability to approximate functions and learn from data samples. While a finite VC dimension is beneficial for uniform convergence of empirical errors, it may hinder function approximation from probability distributions relevant to specific applications. The study highlights the deterministic behavior of approximation and empirical errors in networks with finite VC dimensions.
Training Neural Networks at Any Scale
PositiveArtificial Intelligence
The article reviews modern optimization methods for training neural networks, focusing on efficiency and scalability. It presents state-of-the-art algorithms within a unified framework, emphasizing the need to adapt to specific problem structures. The content is designed for both practitioners and researchers interested in the latest advancements in this field.