arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

ADMM 与线性化 ADMM 用于弱凸最小化

ADMM and Linearized ADMM for Weakly Convex Minimization

Shenghan Mei, Chengyu Ke, Yifei Lou, Miju Ahn

arXiv 2609.12167首次发表:更新:

发表机构

University of North Carolina at Chapel Hill; Southern Methodist University(北卡罗来纳大学教堂山分校; 南方卫理公会大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

针对光滑凸项加弱凸非光滑项的优化问题,提出 ADMM 及线性化 LADMM 分裂算法,证明收敛到方向稳定解,实验验证高效且解质量与基线相当。

AI 中文摘要

我们研究一类弱凸优化问题,其中目标函数是光滑凸项与可能非光滑的弱凸项之和。为利用这一结构,我们基于交替方向乘子法(ADMM)开发了一种分裂技术,将两个分量的最小化解耦为易于处理的子问题。由于与光滑项相关的更新可能需要内部迭代求解器,我们进一步对该项进行线性化,得到具有廉价一步更新的线性化 ADMM(LADMM)方案。在温和条件下,我们建立了 ADMM 和 LADMM 方法对方向稳定解的子序列收敛性,这些解等价于我们弱凸问题中的临界点和 Clarke 稳定解。在两个低维测试函数和一个高维对数正则化逻辑回归模型上的数值实验表明,所提出的方法计算效率高,并能产生与基线方法质量相当的解。

英文摘要

We study a class of weakly convex optimization problems in which the objective is the sum of a smooth convex term and a weakly convex term that may be nonsmooth. To exploit this structure, we develop a splitting technique based on the alternating direction method of multipliers (ADMM), which decouples the minimization of the two components into tractable subproblems. Because the update associated with the smooth term may require an inner iterative solver, we further linearize this term, yielding a linearized ADMM (LADMM) scheme with an inexpensive one-step update. Under mild conditions, we establish the subsequence convergence of both ADMM and LADMM methods to directional stationary solutions, which are equivalent to critical points and Clarke stationary solutions for our weakly convex problem. Numerical experiments on two low-dimensional test functions and a high-dimensional logarithmic regularized logistic regression model demonstrate that the proposed approaches are computationally efficient and produce solutions of comparable quality to baseline methods.

Comments37 pages, 5 figures, 4 tables

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑