arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.06232cs.CV
收藏

HiFlow: 基于流对齐引导的免训练高分辨率图像生成

HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidance

Shanghai Jiao Tong University(上海交通大学);University of Science and Technology of China(中国科学技术大学);The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Innovation Institute(上海创新研究院);CPII under InnoHK(香港创科旗下CPII)

Jiazi Bu, Pengyang Ling, Yujie Zhou, Pan Zhang, Tong Wu, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Dahua Lin, Jiaqi Wang

AI总结:

针对现有免训练高分辨率图像生成方法依赖低分辨率采样终点、易出现伪影和细节失真的问题,提出免训练模型无关框架HiFlow,通过三维流对齐引导提升合成质量,效果优于SOTA方法。

摘要:

文本到图像(T2I)扩散/流模型凭借其出色的灵活视觉创作能力,近年来受到了广泛关注。然而,由于高分辨率内容的稀缺性与复杂性,高分辨率图像合成仍面临着巨大挑战。近期已有研究探索免训练策略,以利用预训练模型实现高分辨率图像合成。但这类技术往往难以生成高质量视觉内容,容易出现伪影或细节保真度低的问题,因为它们通常仅依赖低分辨率采样轨迹的终点,而忽略了对保留结构和合成精细细节至关重要的中间状态。为此,我们提出了HiFlow——一个免训练且模型无关的框架,用于释放预训练流模型的分辨率潜力。具体而言,HiFlow在高分辨率空间中构建了一条虚拟参考流,可有效捕捉低分辨率流信息的特征,并从三个关键方面为高分辨率生成提供引导:保障低频一致性的初始化对齐、实现结构保留的方向对齐,以及提升细节保真度的加速对齐。通过这种流对齐引导,HiFlow大幅提升了T2I模型的高分辨率图像合成质量,且在其个性化变体中展现出通用性。大量实验验证了HiFlow的能力,其高分辨率图像质量优于现有最优方法。

英文摘要:

Text-to-image (T2I) diffusion/flow models have drawn considerable attention recently due to their remarkable ability to deliver flexible visual creations. Still, high-resolution image synthesis presents formidable challenges due to the scarcity and complexity of high-resolution content. Recent approaches have investigated training-free strategies to enable high-resolution image synthesis with pre-trained models. However, these techniques often struggle with generating high-quality visuals and tend to exhibit artifacts or low-fidelity details, as they typically rely solely on the endpoint of the low-resolution sampling trajectory while neglecting intermediate states that are critical for preserving structure and synthesizing finer detail. To this end, we present HiFlow, a training-free and model-agnostic framework to unlock the resolution potential of pre-trained flow models. Specifically, HiFlow establishes a virtual reference flow within the high-resolution space that effectively captures the characteristics of low-resolution flow information, offering guidance for high-resolution generation through three key aspects: initialization alignment for low-frequency consistency, direction alignment for structure preservation, and acceleration alignment for detail fidelity. By leveraging such flow-aligned guidance, HiFlow substantially elevates the quality of high-resolution image synthesis of T2I models and demonstrates versatility across their personalized variants. Extensive experiments validate HiFlow's capability in achieving superior high-resolution image quality over state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑