arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2007.06937math.OCcs.LG
收藏

遵循平分线:一种求解多目标最优化的简单方法

Follow the bisector: a simple method for multi-objective optimization

Skolkovo Institute of Science and Technology(斯科尔科沃科学技术学院);Higher School of Economics(高等经济学院);Huawei Moscow Research Center(华为莫斯科研究中心)

Alexandr Katrutsa, Daniil Merkulov, Nurislam Tursynbek, Ivan Oseledets

摘要:

提出了一种新的求解多目标最优化问题的等角方向法。我们考虑最优化问题,其中多个可微损失必须最小化。该方法在每次迭代中计算下降方向,以保证目标函数的相对减少量相等。该下降方向基于各个损失的归一化梯度。因此,它适合于解决具有多尺度损失的多目标最优化问题。我们测试所提出的方法上的不平衡分类问题和多任务学习问题,其中使用标准数据集。比较了电火花加工与其它方法的优缺点。

英文摘要:

This study presents a novel Equiangular Direction Method (EDM) to solve a multi-objective optimization problem. We consider optimization problems, where multiple differentiable losses have to be minimized. The presented method computes descent direction in every iteration to guarantee equal relative decrease of objective functions. This descent direction is based on the normalized gradients of the individual losses. Therefore, it is appropriate to solve multi-objective optimization problems with multi-scale losses. We test the proposed method on the imbalanced classification problem and multi-task learning problem, where standard datasets are used. EDM is compared with other methods to solve these problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑