arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.20107cs.LGcs.CV
收藏

通过强化学习细化少步文本到多视图扩散模型

Refining Few-Step Text-to-Multiview Diffusion via Reinforcement Learning

School of Computer Science, National Engineering Research Center for Multimedia Software and Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(计算机学院、多媒体软件国家工程研究中心和湖北多媒体与网络通信工程重点实验室、武汉大学);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学信息科学与技术学院深圳校区);Tencent Inc.(腾讯公司);Xiaomi Inc., China(小米公司,中国)

Ziyi Zhang, Li Shen, Deheng Ye, Yong Luo, Huangxuan Zhao, Meng Liu, Wei Yu, Lefei Zhang

AI总结:

本文提出MVC-ZigAL框架,通过联合视图奖励模型和自适应优化策略,提升少步多视图扩散模型的生成质量和一致性。

摘要:

文本到多视图(T2MV)扩散模型在从单个文本提示生成多视角场景中表现出巨大潜力。尽管少步骨干网络能够实现实时T2MV生成,但通常会牺牲生成质量的关键方面,如单视角保真度和跨视角一致性。强化学习(RL)微调提供了一种潜在解决方案,但现有针对单图像扩散模型设计的方法难以扩展到少步T2MV设置,因为它们忽视了跨视角协调并导致弱学习信号。为此,我们提出MVC-ZigAL,一种专门针对少步T2MV扩散模型的RL微调框架。其核心见解包括:(1)新的MDP公式,联合建模所有生成的视角并通过联合视角奖励评估其整体质量;(2)一种新颖的优势学习策略,利用自反思采样方案相对于标准采样带来的性能增益,产生更强的学习信号以实现有效的RL微调;(3)一个统一的RL框架,通过拉格朗日对偶公式扩展优势学习,用于多视角约束优化,通过自适应对偶更新在自 paced阈值课程中平衡单视角和联合视角目标。这些设计共同使少步T2MV扩散模型的RL微调更加稳健和平衡,从而在单视角保真度和跨视角一致性上取得显著提升。代码可在https://github.com/ZiyiZhang27/MVC-ZigAL获取。

英文摘要:

Text-to-multiview (T2MV) diffusion models have shown great promise in generating multiple views of a scene from a single text prompt. While few-step backbones enable real-time T2MV generation, they often compromise key aspects of generation quality, such as per-view fidelity and cross-view consistency. Reinforcement learning (RL) finetuning offers a potential solution, yet existing approaches designed for single-image diffusion do not readily extend to the few-step T2MV setting, as they neglect cross-view coordination and suffer from weak learning signals in few-step regimes. To address this, we propose MVC-ZigAL, a tailored RL finetuning framework for few-step T2MV diffusion models. Specifically, its core insights are: (1) a new MDP formulation that jointly models all generated views and assesses their collective quality via a joint-view reward; (2) a novel advantage learning strategy that exploits the performance gains of a self-refinement sampling scheme over standard sampling, yielding stronger learning signals for effective RL finetuning; and (3) a unified RL framework that extends advantage learning with a Lagrangian dual formulation for multiview-constrained optimization, balancing single-view and joint-view objectives through adaptive primal-dual updates under a self-paced threshold curriculum that harmonizes exploration and constraint enforcement. Collectively, these designs enable robust and balanced RL finetuning for few-step T2MV diffusion models, yielding substantial gains in both per-view fidelity and cross-view consistency. Code is available at https://github.com/ZiyiZhang27/MVC-ZigAL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑