arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

非凸-PŁ极小极大优化的下界

Lower Bounds for Nonconvex-PŁ Minimax Optimization

Siyu Pan, Jiajin Li

arXiv 2608.26799首次发表:更新:

AI 中文总结

该研究针对非凸-PŁ极小极大优化,证明确定性一阶方法寻找满足梯度范数不超过ε的平稳点时,预言机查询下界为Ω(ℓΔκ/ε²),且该下界与已知上界匹配,确定了κ的线性依赖不可避免。

AI 中文摘要

我们研究光滑非凸-Polyak-Łojasiewicz(NC-PŁ)极小极大优化中,寻找值函数平稳点的确定性一阶预言机复杂度。假设目标函数是联合ℓ-光滑的,且在对偶变量上满足μ-PŁ条件,其值函数Φ(x):=max_y f(x;y)满足Φ(0)-inf_x Φ(x)≤Δ。当κ:=ℓ/μ≳1且0<ε²≲ℓΔ时,我们证明,最坏情况下,每个确定性一阶方法需要Ω(ℓΔκ/ε²)次预言机查询,才能找到满足||∇Φ(x)||≤ε的x。该速率在对(ℓ,Δ,κ,ε)的依赖上与已知上界[Yang等人,2022]匹配,表明确定性一阶方法对κ的线性依赖是不可避免的。

英文摘要

We study the deterministic first-order oracle complexity of finding stationary points of the value function in smooth nonconvex-Polyak-Łojasiewicz (NC-PŁ) minimax optimization. We assume that the objective is jointly $\ell$-smooth and satisfies the $μ$-PŁ condition in the dual variable, and that its value function $Φ(x):=\max_y f(x;y)$ satisfies $Φ(0)-\inf_xΦ(x)\leqΔ$. When $κ:=\ell/μ\gtrsim 1$ and $0<ε^2\lesssim\ellΔ$, we prove that every deterministic first-order method requires $Ω(\ellΔκ/ε^2)$ oracle queries in the worst case to find $x$ satisfying $\|\nablaΦ(x)\|\leqε$. This rate matches the known upper bound in its dependence on $(\ell,Δ,κ,ε)$ [Yang et al., 2022] and shows that the linear dependence on $κ$ is unavoidable for deterministic first-order methods.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑