Trawiński, Bogdan ; Smętek, Magdalena ; Telec, Zbigniew ; Lasota, Tadeusz
Cordón, Oskar - ed. ; Kazienko, Przemysław - ed.
Hybrid and Ensemble Methods in Machine Learning
In the paper we present some guidelines for the application of nonparametric statistical tests and post-hoc procedures devised to perform multiple comparisons of machine learning algorithms. We emphasize that it is necessary to distinguish between pairwise and multiple comparison tests. ; We show that the pairwise Wilcoxon test, when employed to multiple comparisons, will lead to overoptimistic conclusions. We carry out intensive normality examination employing ten different tests showing that the output of machine learning algorithms for regression problems does not satisfy normality requirements. ; We conduct experiments on nonparametric statistical tests and post-hoc procedures designed for multiple 1×N and N×N comparisons with six different neural regression algorithms over 29 benchmark regression data sets. Our investigation proves the usefulness and strength of multiple comparison statistical procedures to analyse and select machine learning algorithms.
Zielona Góra: Uniwersytet Zielonogórski
AMCS, Volume 22, Number 4 (2012) ; click here to follow the link
Biblioteka Uniwersytetu Zielonogórskiego
Jul 14, 2025
Sep 15, 2021
282
https://zbc.uz.zgora.pl/repozytorium/publication/65814
| Edition name | Date |
|---|---|
| Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms | Jul 14, 2025 |
Qian, Yaguan Zhang, Liangjian Wang, Yugi Ji, Boyuan Yao, Tengteng Wang, Bin Korbicz, Józef (1951- ) - red. Uciński, Dariusz - red.
Awais, Muhammad Akram, Tallha Alasiry, Areej Marzougui, Mehrez Park, Jongwoon Chang, Byoungchol Woźniak, Marcin - ed. Kumar, Yogesh - ed. Ijaz, Muhammad Fazal - ed.
Bouzaffour, Mohamed Nassraoui, Mohammed Jurczak, Paweł - red.
Tenne, Yoel Korbicz, Józef (1951- ) - red. Uciński, Dariusz - red.
Praczyk, Tomasz Korbicz, Józef (1951- ) - red.
Koziarski, Michał Woźniak, Michał Stefanowski, Jerzy - ed. Krawiec, Krzysztof - ed. Wrembel, Robert - ed.
Blachnik, Marcin Gamper, Johann - ed. Wrembel, Robert - ed.
Żelasko, Dariusz Pławiak, Paweł Korbicz, Józef (1951- ) - red. Uciński, Dariusz - red.