Mathematics | |
RHOASo: An Early Stop Hyper-Parameter Optimization Algorithm | |
Noemí DeCastro-García1  Ángel Luis Muñoz Castañeda1  David Escudero García2  | |
[1] Department of Mathematics, Universidad de León, 24007 León, Spain;Research Institute of Applied Sciences in Cybersecurity (RIASC), Universidad de León, 24007 León, Spain; | |
关键词: hyperparameters; machine learning; optimization; inference; | |
DOI : 10.3390/math9182334 | |
来源: DOAJ |
【 摘 要 】
This work proposes a new algorithm for optimizing hyper-parameters of a machine learning algorithm, RHOASo, based on conditional optimization of concave asymptotic functions. A comparative analysis of the algorithm is presented, giving particular emphasis to two important properties: the capability of the algorithm to work efficiently with a small part of a dataset and to finish the tuning process automatically, that is, without making explicit, by the user, the number of iterations that the algorithm must perform. Statistical analyses over 16 public benchmark datasets comparing the performance of seven hyper-parameter optimization algorithms with RHOASo were carried out. The efficiency of RHOASo presents the positive statistically significant differences concerning the other hyper-parameter optimization algorithms considered in the experiments. Furthermore, it is shown that, on average, the algorithm needs around
【 授权许可】
Unknown