arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

一种用于随机多目标优化样本平均近似的自适应投影梯度算法

An Adaptive Projected-Gradient Algorithm for Sample-Average Approximations of Stochastic Multi-Objective Optimization

Yiyang Li, Lei Wang, Xiaojun Chen

arXiv 2609.02722首次发表:更新:

发表机构

Department of Applied Mathematics, The Hong Kong Polytechnic University(香港理工大学应用数学系)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

针对仅能获取样本梯度信息的随机多目标优化样本平均近似问题,提出无行搜索无函数值的自适应投影梯度算法,经多类实验验证了其实用性能。

AI 中文摘要

我们研究非空闭凸集上的随机多目标优化问题,其中每个目标为期望函数,仅能获取样本梯度信息。我们针对样本平均近似(SAA)问题,提出一种无行搜索、无函数值的自适应投影梯度算法。每次迭代计算可行的正则化多梯度步,并根据投影步长更新正则化参数。基于法锥的证书可得到SAA问题帕累托平稳性残差的下降估计和显式复杂度界;SAA梯度的一致性将SAA残差的消失特性传递至总体问题的帕累托平稳性,额外的集中论证则给出紧集上的有限样本残差界。在合成问题、分类、投资组合选择、多任务学习及机器人控制上的实验,验证了该算法的实用性能。

英文摘要

We consider stochastic multi-objective optimization over a nonempty closed convex set, where every objective is an expectation and only sample-gradient information is available. We develop a line-search-free and function-value-free adaptive projected-gradient algorithm for the sample-average approximation (SAA) problem. Each iteration computes a feasible regularized multi-gradient step and updates the regularization parameter from the projected step length. A normal-cone-based certificate yields descent estimates and an explicit complexity bound for the Pareto-stationarity residual of the SAA problem. The consistency of SAA gradients then transfers vanishing SAA residuals to Pareto stationarity for the population problem, while an additional concentration argument gives a finite-sample residual bound on compact sets. Experiments on synthetic problems, classification, portfolio selection, multi-task learning, and robot control illustrate the practical performance of our algorithm.

Comments27 pages, 6 figures

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑