期刊论文详细信息
Mathematics
RHOASo: An Early Stop Hyper-Parameter Optimization Algorithm
Noemí DeCastro-García1  Ángel Luis Muñoz Castañeda1  David Escudero García2 
[1] Department of Mathematics, Universidad de León, 24007 León, Spain;Research Institute of Applied Sciences in Cybersecurity (RIASC), Universidad de León, 24007 León, Spain;
关键词: hyperparameters;    machine learning;    optimization;    inference;   
DOI  :  10.3390/math9182334
来源: DOAJ
【 摘 要 】

This work proposes a new algorithm for optimizing hyper-parameters of a machine learning algorithm, RHOASo, based on conditional optimization of concave asymptotic functions. A comparative analysis of the algorithm is presented, giving particular emphasis to two important properties: the capability of the algorithm to work efficiently with a small part of a dataset and to finish the tuning process automatically, that is, without making explicit, by the user, the number of iterations that the algorithm must perform. Statistical analyses over 16 public benchmark datasets comparing the performance of seven hyper-parameter optimization algorithms with RHOASo were carried out. The efficiency of RHOASo presents the positive statistically significant differences concerning the other hyper-parameter optimization algorithms considered in the experiments. Furthermore, it is shown that, on average, the algorithm needs around 70% of the iterations needed by other algorithms to achieve competitive performance. The results show that the algorithm presents significant stability regarding the size of the used dataset partition.

【 授权许可】

Unknown   

  文献评价指标  
  下载次数:0次 浏览次数:0次