arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.19680cs.CV

IR-Flow:通过修正流弥合判别与生成图像修复的鸿沟

IR-Flow: Bridging Discriminative and Generative Image Restoration via Rectified Flow

MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, School of Information Science and Technology, University of Science and Technology of China(脑启发智能感知与认知联合实验室,信息科学与技术学院,中国科学技术大学)

Zihao Fan, Xin Lu, Jie Xiao, Dong Li, Jie Huang, Xueyang Fu

AI总结:

IR-Flow通过修正流框架结合判别与生成方法,提升图像修复的细节与效率,实现多级数据分布和累积速度场,增强修复性能与适应性。

摘要:

在图像修复中,单步判别映射因期望学习缺乏细节,而生成方法则面临多步采样效率低和噪声残差耦合的问题。为此,我们提出IR-Flow,一种基于修正流的新型图像修复方法,作为连接判别与生成范式的统一框架。首先构建多级数据分布流,扩展模型学习和适应不同降质水平的能力。随后提出累积速度场,学习跨不同降质水平的传输轨迹,引导中间状态向干净目标发展,同时引入多步一致性约束以增强轨迹一致性并提升少步修复性能。我们证明直接建立降质与干净图像域之间的线性传输流不仅加快推理速度,还提高对分布外降质的适应性。在去雨、去噪和去除雨滴任务中的广泛评估表明,IR-Flow仅需少量采样步骤即可取得竞争性的定量结果,提供了一个高效且灵活的框架,保持了出色的失真感知平衡。我们的代码可在https://github.com/fanzh03/IR-Flow获取。

英文摘要:

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we propose IR-Flow, a novel image restoration method based on Rectified Flow that serves as a unified framework bridging the gap between discriminative and generative paradigms. Specifically, we first construct multilevel data distribution flows, which expand the ability of models to learn from and adapt to various levels of degradation. Subsequently, cumulative velocity fields are proposed to learn transport trajectories across varying degradation levels, guiding intermediate states toward the clean target, while a multi-step consistency constraint is presented to enforce trajectory coherence and boost few-step restoration performance. We show that directly establishing a linear transport flow between degraded and clean image domains not only enables fast inference but also improves adaptability to out-of-distribution degradations. Extensive evaluations on deraining, denoising and raindrop removal tasks demonstrate that IR-Flow achieves competitive quantitative results with only a few sampling steps, offering an efficient and flexible framework that maintains an excellent distortion-perception balance. Our code is available at https://github.com/fanzh03/IR-Flow.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑