arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1611.04801math.OC
收藏

希尔伯特空间中具有松弛的完全预条件ADMM的分析

Analysis of Fully Preconditioned ADMM with Relaxation in Hilbert Spaces

Hongpeng Sun

摘要:

乘子交替方向法(ADMM)是一种有效的一阶方法,在信号处理和成像中有着广泛的应用。然而,Eckstein和Bertsakas的\cite{EP}在无限维希尔伯特空间中研究的带松弛的ADMM的弱收敛性至今没有明确的结果.本文利用一种“部分”间隙分析,证明了无限维希尔伯特空间中一般的预条件松弛ADMM的弱收敛性,并在较弱的条件下对所有涉及的隐式方程进行了预处理.对于“部分”间隙函数,我们也给出了相应的遍历收敛速度。此外,根据\cite{DGBA}中Gabay的思想,还讨论了某些预处理和松弛ADMM与相应的Douglas-Rachford分裂方法之间的联系.数值试验也表明了所提出的预处理ADMM的超松弛变体的效率。

英文摘要:

Alternating direction method of multipliers (ADMM) is a powerful first order methods for various applications in signal processing and imaging. However, there is no clear result on the weak convergence of ADMM with relaxation studied by Eckstein and Bertsakas \cite{EP} in infinite dimensional Hilbert spaces. In this paper, by employing a kind of "partial" gap analysis, we prove the weak convergence of general preconditioned and relaxed ADMM in infinite dimensional Hilbert spaces, with preconditioning for solving all the involved implicit equations under mild conditions. We also give the corresponding ergodic convergence rates respecting to the "partial" gap function. Furthermore, the connections between certain preconditioned and relaxed ADMM and the corresponding Douglas-Rachford splitting methods are also discussed, following the idea of Gabay in \cite{DGBA}. Numerical tests also show the efficiency of the proposed overrelaxation variants of preconditioned ADMM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑