arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.04493cs.LG
收藏

PROUD:面向多目标生成的帕累托引导扩散模型

PROUD: PaRetO-gUided Diffusion Model for Multi-objective Generation

Centre for Frontier AI Research, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局前沿人工智能研究中心);Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);Lingnan University(岭南大学)

Yinghua Yao, Yuangang Pan, Jing Li, Ivor Tsang, Xin Yao

AI总结:

本文提出PROUD模型,通过约束优化将生成质量与多属性帕累托最优性统一建模,并在去噪过程中动态调整梯度,在图像和蛋白质生成任务上同时实现高质量与多目标帕累托最优。

摘要:

深度生成模型领域的最新进展聚焦于生成满足多个期望属性的样本。然而,主流方法独立地优化这些属性函数,从而忽略了它们之间的权衡关系。此外,属性优化常常被不恰当地整合到生成模型中,导致生成质量(即生成样本的质量)出现不必要的折损。为解决这些问题,我们构建了一个约束优化问题,旨在优化生成质量,同时确保生成样本位于多个属性目标的帕累托前沿上。这种构建方式使得生成的样本无法在相互冲突的属性函数上同时得到进一步改善,并保持了生成样本的良好质量。基于这一构建,我们提出了帕累托引导扩散模型(PROUD),其中去噪过程中的梯度被动态调整,以提升生成质量,同时使生成的样本满足帕累托最优性。在图像生成和蛋白质生成任务上的实验评估表明,与多种基线方法相比,我们的PROUD在多个属性函数上持续保持优越的生成质量,同时逼近帕累托最优性。

英文摘要:

Recent advancements in the realm of deep generative models focus on generating samples that satisfy multiple desired properties. However, prevalent approaches optimize these property functions independently, thus omitting the trade-offs among them. In addition, the property optimization is often improperly integrated into the generative models, resulting in an unnecessary compromise on generation quality (i.e., the quality of generated samples). To address these issues, we formulate a constrained optimization problem. It seeks to optimize generation quality while ensuring that generated samples reside at the Pareto front of multiple property objectives. Such a formulation enables the generation of samples that cannot be further improved simultaneously on the conflicting property functions and preserves good quality of generated samples. Building upon this formulation, we introduce the PaRetO-gUided Diffusion model (PROUD), wherein the gradients in the denoising process are dynamically adjusted to enhance generation quality while the generated samples adhere to Pareto optimality. Experimental evaluations on image generation and protein generation tasks demonstrate that our PROUD consistently maintains superior generation quality while approaching Pareto optimality across multiple property functions compared to various baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑