arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.24800cs.CV

Calibri: 通过参数高效校准增强扩散变换器

Calibri: Enhancing Diffusion Transformers via Parameter-Efficient Calibration

MSU(莫斯科国立大学);FusionBrain Lab, AXXX(FusionBrain实验室,AXXX)

Danil Tokhchukov, Aysel Mirzoeva, Andrey Kuznetsov, Konstantin Sobolev

AI总结:

本文通过深入分析去噪过程,提出Calibri方法,通过引入单个学习缩放参数提升DiT性能,优化校准以提高生成质量,减少推理步骤并保持高质量输出。

摘要:

在本文中,我们揭示了扩散变换器(DiTs)在显著增强生成任务中的潜在能力。通过深入分析去噪过程,我们证明引入单个学习缩放参数可以显著提高DiT块的性能。基于这一见解,我们提出了Calibri,一种参数高效的校准方法,通过最优校准DiT组件以提高生成质量。Calibri将DiT校准视为一个黑盒奖励优化问题,使用进化算法高效求解,并仅修改约100个参数。实验结果表明,尽管其设计轻量,Calibri在各种文本到图像模型中一致提升了性能。值得注意的是,Calibri还减少了图像生成所需的推理步骤,同时保持高质量输出。

英文摘要:

In this paper, we uncover the hidden potential of Diffusion Transformers (DiTs) to significantly enhance generative tasks. Through an in-depth analysis of the denoising process, we demonstrate that introducing a single learned scaling parameter can significantly improve the performance of DiT blocks. Building on this insight, we propose Calibri, a parameter-efficient approach that optimally calibrates DiT components to elevate generative quality. Calibri frames DiT calibration as a black-box reward optimization problem, which is efficiently solved using an evolutionary algorithm and modifies just ~100 parameters. Experimental results reveal that despite its lightweight design, Calibri consistently improves performance across various text-to-image models. Notably, Calibri also reduces the inference steps required for image generation, all while maintaining high-quality outputs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑