In this paper, we present the compact representation for matrices belonging to the the Broyden class of quasi-Newton updates, where each update may be either rank-one or rank-two. This work extends previous results solely for the restricted Broyden class of rank-two updates. In this article, it is not assumed the same Broyden update is used each iteration; rather, different members of the Broyden class may be used each iteration. Numerical experiments suggest that a practical implementation of the compact representation is able to accurately represent matrices belonging to the Broyden class of updates. Furthermore, we demonstrate how to compute the compact representation for the inverse of these matrices, as well as a practical algorithm for solving linear systems with members of the Broyden class of updates. We demonstrate through numerical experiments that the proposed linear solver is able to efficiently solve linear systems with members of the Broyden class of matrices to high accuracy. As an immediate consequence of this work, it is now possible to efficiently compute the eigenvalues of any limited-memory member of the Broyden class of matrices, allowing for the computation of condition numbers and the ability perform sensitivity analysis.
Quasi-Newton methods on Grassmannians and multilinear approximations of tensors
Linköping University(林雪平大学);Institute for Computational Engineering and Sciences, The University of Texas at Austin(德克萨斯大学奥斯汀分校计算工程与科学研究所);Department of Mathematics, University of California, Berkeley(加州大学伯克利分校数学系)
An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values
University of Sheffield(谢菲尔德大学);Purdue University(普渡大学);University of Science and Technology of China(中国科学技术大学);University of Oulu(奥卢大学);University College London(伦敦大学学院)