当松弛的PEP是精确的时：Nesterov快速梯度法的精确查询梯度速率
When a Relaxed PEP Is Exact: The Sharp Queried-Gradient Rate of Nesterov's Fast Gradient Method
浏览论文内容
中文总结 AI 辅助
该研究确定Nesterov快速梯度法在光滑凸函数上的精确查询梯度速率，构造匹配解析族并证明其达到松弛PEP上界，为秩一松弛PEP的精确性传播提供假设。
中文摘要 AI 辅助
我们确定了对于任意水平数N≥7，Nesterov快速梯度法在光滑凸函数上生成的最小查询梯度范数的精确最坏情况值。令t₀=1，t_{k+1}=(1+√(1+4t_k²))/2，x₀,…,x_N表示该方法评估梯度的点。对于任意这样的N和任意维度d≥N-4，我们证明：在所有f∈F_{0,L}(ℝ^d)、x⋆∈argmin f且满足‖x₀−x⋆‖≤R的情况下，min_{0≤k≤N}‖∇f(x_k)‖²的上确界等于L²R²除以∑_{k=0}^N t_k²。松弛PEP的上界由Kim和Fessler给出，他们还报告了在选定水平数下精确插值PEP的紧数值解，但缺失的是在整个水平数范围内有效的解析匹配族。对于任意N≥7，我们使用FGM特有的球形多面体K_N和标准投影-包络函数f_N(x)=max_{g∈K_N}{⟨x,g⟩−1/2‖g‖²}（其梯度∇f_N(x)=Proj_{K_N}(x)）构造了这样一个族。每个查询梯度具有相同的范数，K_N的顶点通过三维种子经一维球形锥提升生成，该提升保留所有投影不等式且每水平数将对手维度提高1。投影/Moreau包络模板本身是经典的，新要素包括FGM特有的代数种子、证明其达到松弛界的过程，以及将此精确性传播到所有N≥7的同纬度提升；我们给出了该传播的精确假设，并未声称所有秩一松弛PEP都存在此类种子。
英文摘要
We determine the exact worst-case value, at every horizon $N\geq7$, of the smallest queried gradient norm generated by Nesterov's fast gradient method on smooth convex functions. Let $t_0=1$ and $t_{k+1}=(1+\sqrt{1+4t_k^2})/2$, and let $x_0,\ldots,x_N$ denote the points at which the method evaluates gradients. For every such $N$ and every dimension $d\geq N-4$, we prove \[ \sup_{\substack{f\in\F_{0,L}(\R^d),\ x_\star\in\arg\min f \norm{x_0-x_\star}\leq R}} \min_{0\leq k\leq N}\norm{\nabla f(x_k)}^2 =\frac{L^2R^2}{\sum_{k=0}^N t_k^2}. \] The relaxed-PEP upper bound is due to Kim and Fessler, who also reported tight numerical solutions of the exact-interpolation PEP at selected horizons. What remained missing was an analytic matching family valid uniformly over the horizon. For every $N\geq7$, we construct such a family using an FGM-specific spherical polytope $K_N$ and the standard projection-envelope function \[ f_N(x)=\max_{g\in K_N}\left\{\ip{x}{g}-\frac12\norm{g}^2\right\}, \qquad \nabla f_N(x)=\Proj_{K_N}(x). \] Every queried gradient has the same norm, and the vertices of $K_N$ are generated from a three-dimensional seed by a one-dimensional spherical cone lift. The lift preserves all projection inequalities and raises the adversary dimension by one at each horizon. The projection/Moreau-envelope template itself is classical; the new ingredients are the FGM-specific algebraic seed, the proof that it attains the relaxed bound, and the common-latitude lift that propagates this exactness to every $N\geq7$. We state precise hypotheses for that propagation and do not claim that every rank-one relaxed PEP admits such a seed.
