利用生成式监督改进复杂莫尔条纹去除
Improving Complex Moiré Removal with Generative Supervision
AI总结：
本研究针对现有数据集难以覆盖真实场景复杂莫尔条纹的问题，提出生成式监督数据引擎，构建WildMoiré数据集，在多模型上验证其可提升复杂莫尔条纹去除性能。
AI中文摘要：
高质量配对数据的可用性对于训练基于学习的图像莫尔条纹去除模型至关重要。然而，现有数据集仍难以涵盖在不受控制的真实场景中捕获的复杂莫尔条纹图案，这类退化通常表现为大规模、多色的莫尔条纹图案，且这些图案常出现在难以获得干净对应图像的场景中，例如从公共显示屏或现有在线资源获取的照片。本研究提出一种新型数据引擎，旨在通过生成训练监督信号来改进复杂莫尔条纹的去除效果。具体而言，我们首先收集包含复杂莫尔条纹的真实图像并定位对应的屏幕区域，随后部署多个基于图像条件的生成式基础模型来生成候选参考图像。为建立可靠的监督信号，我们对这些候选图像进行补丁级质量控制，以过滤并选择最优结果。基于该系统范式，我们构建了WildMoiré数据集，其中包含6800对莫尔条纹-真实图像训练样本。为进行评估，我们额外构建了一个包含约250对捕获的干净真实图像的独立测试集。在ESDNet、SDXL和Qwen-Image-Edit上开展的大量实验表明，所提出的生成式监督可持续提升复杂莫尔条纹去除的性能。
英文摘要：
The availability of high-quality paired data is essential for training learning-based image demoiréing models. However, it remains challenging for existing datasets to encompass the complex moiré patterns captured in uncontrolled real-world scenarios. Such degradations typically manifest as large-scale, multicolored moiré patterns. Moreover, these patterns frequently occur in images for which clean counterparts are difficult to obtain, such as photographs acquired from public displays or existing online resources. In this work, we propose a novel data engine designed to improve the removal of complex moiré patterns by generating training supervision. Specifically, we initially collect real-world images containing complex moiré patterns and localize the corresponding screen regions. Multiple image-conditioned generative foundation models are subsequently deployed to produce candidate references. To establish reliable supervision, these candidates are subjected to patch-level quality control to filter and select the optimal results. Based on this systematic paradigm, we construct the WildMoiré dataset, which contains 6.8K moiré-GT training pairs. For evaluation, we additionally build an independent test set comprising $\sim$250 pairs with captured clean ground truth. Extensive experiments on ESDNet, SDXL, and Qwen-Image-Edit demonstrate that the proposed generative supervision consistently improves the performance of complex moiré removal.
