arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.07536cs.CV
收藏

I-Max:通过 Projected Flow 最大化预训练 Rectified Flow Transformers 的分辨率潜力

I-Max: Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers with Projected Flow

Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)

Ruoyi Du, Dongyang Liu, Le Zhuo, Qin Qi, Hongsheng Li, Zhanyu Ma, Peng Gao

AI总结:

本文提出 I-Max 框架,通过 Projected Flow 策略和先进推理工具包,提升预训练 Rectified Flow Transformers 的免调谐分辨率外推稳定性,并在实验中验证了其增强图像细节和校正伪影的能力。

摘要:

Rectified Flow Transformers (RFTs) 提供卓越的训练和推理效率,使其可能成为扩散模型扩展的最可行方向。然而,由于数据质量和训练成本,生成分辨率的进展相对缓慢。免调谐分辨率外推提供了一种替代方案,但当前方法通常会降低生成稳定性,限制了实际应用。本文回顾了现有的分辨率外推方法,并引入 I-Max 框架以最大化 Text-to-Image RFTs 的分辨率潜力。I-Max 的特点是:(i) 一种用于稳定外推的新型 Projected Flow 策略;(ii) 一种用于将模型知识泛化到更高分辨率的先进推理工具包。在 Lumina-Next-2K 和 Flux.1-dev 上的实验表明,I-Max 能够增强分辨率外推的稳定性,并带来图像细节涌现和伪影校正,证实了免调谐分辨率外推的实用价值。

英文摘要:

Rectified Flow Transformers (RFTs) offer superior training and inference efficiency, making them likely the most viable direction for scaling up diffusion models. However, progress in generation resolution has been relatively slow due to data quality and training costs. Tuning-free resolution extrapolation presents an alternative, but current methods often reduce generative stability, limiting practical application. In this paper, we review existing resolution extrapolation methods and introduce the I-Max framework to maximize the resolution potential of Text-to-Image RFTs. I-Max features: (i) a novel Projected Flow strategy for stable extrapolation and (ii) an advanced inference toolkit for generalizing model knowledge to higher resolutions. Experiments with Lumina-Next-2K and Flux.1-dev demonstrate I-Max's ability to enhance stability in resolution extrapolation and show that it can bring image detail emergence and artifact correction, confirming the practical value of tuning-free resolution extrapolation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑