基于梯度的多目标深度学习:算法、理论、应用及展望
Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond
AI总结:
本文系统综述基于梯度的多目标深度学习方法,按输出类型分类算法,涵盖理论、应用与挑战,并提供开源资源列表。
摘要:
许多现代深度学习应用需要平衡多个往往相互冲突的目标,例如多任务学习、公平性学习以及大型语言模型(LLMs)的对齐。这催生了多目标深度学习,它试图通过借鉴多目标优化(MOO)领域的数学原理来寻找最优权衡或帕累托最优解。然而,将基于梯度的多目标优化技术直接应用于深度神经网络面临独特挑战,包括高计算成本、优化不稳定以及难以有效融入用户偏好。本文对基于梯度的多目标深度学习技术进行了全面综述。我们根据其输出对现有算法进行系统分类:(i)寻找单一、良好平衡解的方法;(ii)生成一组有限且多样化的帕累托最优解的方法;(iii)学习连续帕累托解集的方法。除这一分类体系外,本综述还涵盖理论分析、关键应用、实用资源,并重点指出了开放挑战和未来研究的有前景方向。多目标深度学习算法的综合列表可在 https://github.com/Baijiong-Lin/Awesome-Multi-Objective-Deep-Learning 获取。
英文摘要:
Many modern deep learning applications require balancing multiple objectives that are often conflicting. Examples include multi-task learning, fairness-aware learning, and the alignment of Large Language Models (LLMs). This leads to multi-objective deep learning, which tries to find optimal trade-offs or Pareto-optimal solutions by adapting mathematical principles from the field of Multi-Objective Optimization (MOO). However, directly applying gradient-based MOO techniques to deep neural networks presents unique challenges, including high computational costs, optimization instability, and the difficulty of effectively incorporating user preferences. This paper provides a comprehensive survey of gradient-based techniques for multi-objective deep learning. We systematically categorize existing algorithms based on their outputs: (i) methods that find a single, well-balanced solution, (ii) methods that generate a finite set of diverse Pareto-optimal solutions, and (iii) methods that learn a continuous Pareto set of solutions. In addition to this taxonomy, the survey covers theoretical analyses, key applications, practical resources, and highlights open challenges and promising directions for future research. A comprehensive list of multi-objective deep learning algorithms is available at https://github.com/Baijiong-Lin/Awesome-Multi-Objective-Deep-Learning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。