广义分数阶梯度下降法的设计
Design of generalized fractional order gradient descent method
摘要:
针对分数阶梯度下降法的收敛性问题,提出了三种解决方法。实际上,一般的分数阶梯度法不能收敛到目标函数的真正极值点,这严重地限制了该方法的应用。由于分数阶导数的长记忆特性,固定记忆原理是一种优先选择。除了截断存储长度外,还提出了两种新的方法来达到收敛性。一种是无穷级数的截断,另一种是常分数阶的修正。最后,通过六个算例验证了所提方法的有效性和实用性.
英文摘要:
This paper focuses on the convergence problem of the emerging fractional order gradient descent method, and proposes three solutions to overcome the problem. In fact, the general fractional gradient method cannot converge to the real extreme point of the target function, which critically hampers the application of this method. Because of the long memory characteristics of fractional derivative, fixed memory principle is a prior choice. Apart from the truncation of memory length, two new methods are developed to reach the convergence. The one is the truncation of the infinite series, and the other is the modification of the constant fractional order. Finally, six illustrative examples are performed to illustrate the effectiveness and practicability of proposed methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。