深度学习算法中超参数的调整方法
The observer-assisted method for adjusting hyper-parameters in deep learning algorithms
摘要:
本文提出了一种用于调整深度学习(DL)算法中超参数的新方法的概念。外部代理观察器监视所选深度学习算法的性能。观察者学习使用一系列随机实验对DL算法建模。因此,它可以用于根据所选择的质量测量来预测DL算法对一组超参数的响应。这允许构建由一系列评估器组成的集合,所述评估器构成了一个辅助架构。该架构可以用于以由进度单元管理的微小步骤逐渐地向最佳可实现的质量分数前进。当达到最大步数或没有进一步的进展时,算法停止。
英文摘要:
This paper presents a concept of a novel method for adjusting hyper-parameters in Deep Learning (DL) algorithms. An external agent-observer monitors a performance of a selected Deep Learning algorithm. The observer learns to model the DL algorithm using a series of random experiments. Consequently, it may be used for predicting a response of the DL algorithm in terms of a selected quality measurement to a set of hyper-parameters. This allows to construct an ensemble composed of a series of evaluators which constitute an observer-assisted architecture. The architecture may be used to gradually iterate towards to the best achievable quality score in tiny steps governed by a unit of progress. The algorithm is stopped when the maximum number of steps is reached or no further progress is made.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。