arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2602.00883cs.CVcs.AI
收藏

DIAMOND:面向流匹配模型中伪影抑制的定向推理

DIAMOND: Directed Inference for Artifact Mitigation in Flow Matching Models

Silesian University of Technology(桑特大学技术学院);Jagiellonian University(雅盖隆大学);IDEAS Research Institute(IDEAS研究机构)

Alicja Polowczyk, Agnieszka Polowczyk, Piotr Borycki, Joanna Waczyńska, Jacek Tabor, Przemysław Spurek

AI总结:

DIAMOND是一种无需训练的流匹配模型伪影抑制方法,通过轨迹修正在推理过程中主动引导生成过程,实现高质量无伪影图像合成。

摘要:

尽管最近的文本到图像模型如FLUX取得了令人印象深刻的结果,但视觉和解剖伪影仍然是实际和专业应用中的重大障碍。现有伪影减少方法通常以事后方式工作,因此无法在核心图像形成过程中有效干预。值得注意的是,当前技术需要有问题且侵入性的模型权重修改,或依赖于计算成本高且耗时的区域细化过程。为了解决这些限制,我们提出了DIAMOND,一种无需训练的方法,它在推理过程中应用轨迹修正来抑制伪影。通过在生成轨迹的每一步重建干净样本的估计,DIAMOND主动将生成过程引导远离导致伪影的潜在状态。此外,我们扩展了提出的方法到标准扩散模型,证明DIAMOND提供了一条稳健的、零样本路径,实现高保真度、无伪影的图像合成,而无需在现代生成架构中进行额外的训练或权重修改。代码可在https://gmum.github.io/DIAMOND/上获得。

英文摘要:

Despite impressive results from recent text-to-image models like FLUX, visual and anatomical artifacts remain a significant hurdle for practical and professional use. Existing methods for artifact reduction, typically work in a post-hoc manner, consequently failing to intervene effectively during the core image formation process. Notably, current techniques require problematic and invasive modifications to the model weights, or depend on a computationally expensive and time-consuming process of regional refinement. To address these limitations, we propose DIAMOND, a training-free method that applies trajectory correction to mitigate artifacts during inference. By reconstructing an estimate of the clean sample at every step of the generative trajectory, DIAMOND actively steers the generation process away from latent states that lead to artifacts. Furthermore, we extend the proposed method to standard Diffusion Models, demonstrating that DIAMOND provides a robust, zero-shot path to high-fidelity, artifact-free image synthesis without the need for additional training or weight modifications in modern generative architectures. Code is available at https://gmum.github.io/DIAMOND/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑