Ensemble learning is widely recognized as an effective strategy for improving predictive performance by combining multiple machine learning models. In this study, we consider ensembles obtained as weighted averages of different models: a linear regression, a random forest and a neural network, and propose to optimise their weights by maximising a convex combination between the predictive R2 and the Rank Graduation accuracy, in a cross validation setting. We compare different types of averages: arithmetic, quadratic, geometric and harmonic. We illustrate our proposal by means of simulations and by the application to the Boston Housing Prices dataset. The optimised ensemble models achieve, under certain conditions, a lower mean squared error relative to the best single model.

Powered Mean Ensemble Learning / Giudici, P., Polinesi, G., Mariani, F., Recchioni, M.C.. - (2026), pp. 184-193. (19th Conference of the International Federation of Classification Societies, IFCS 2026 ita 2026) [10.1007/978-3-032-32009-4_23].

Powered Mean Ensemble Learning

Polinesi, Gloria;Mariani, Francesca;Recchioni, Maria Cristina
2026-01-01

Abstract

Ensemble learning is widely recognized as an effective strategy for improving predictive performance by combining multiple machine learning models. In this study, we consider ensembles obtained as weighted averages of different models: a linear regression, a random forest and a neural network, and propose to optimise their weights by maximising a convex combination between the predictive R2 and the Rank Graduation accuracy, in a cross validation setting. We compare different types of averages: arithmetic, quadratic, geometric and harmonic. We illustrate our proposal by means of simulations and by the application to the Boston Housing Prices dataset. The optimised ensemble models achieve, under certain conditions, a lower mean squared error relative to the best single model.
2026
9783032320087
9783032320094
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/366751
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact