arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.07930math.NAcs.NA
收藏

非Lipschitz梯度函数的一种改进的非线性共轭梯度算法

A Modified Nonlinear Conjugate Gradient Algorithm for Functions with Non-Lipschitz Gradient

Bingjie Li, Tianhao Ni, Zhenyue Zhang

摘要:

本文对梯度为非Lipschitz连续的函数提出了一种改进的非线性共轭梯度法。首先,我们提出了一个新的公式,共轭系数β_k的NCG,进行搜索方向,提供了一个适当的功能减少。对于不含Lipschitz连续梯度的连续微分函数,我们的NCG算法保证强收敛。其次,我们提出了一个简单的插值方法,可以自动实现收缩,产生一个步长满足标准的沃尔夫条件,在每一步。我们的框架大大拓宽了NCG的适用性,并保留了优越的数值性能的PRP型方法。

英文摘要:

In this paper, we propose a modified nonlinear conjugate gradient (NCG) method for functions with a non-Lipschitz continuous gradient. First, we present a new formula for the conjugate coefficient β_k in NCG, conducting a search direction that provides an adequate function decrease. We can derive that our NCG algorithm guarantees strongly convergent for continuous differential functions without Lipschitz continuous gradient. Second, we present a simple interpolation approach that could automatically achieve shrinkage, generating a step length satisfying the standard Wolfe conditions in each step. Our framework considerably broadens the applicability of NCG and preserves the superior numerical performance of the PRP-type methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑