Disharmony:基于逆向光照协调的取证技术
Disharmony: Forensics using Reverse Lighting Harmonization
AI总结:
针对现有图像取证模型难检测与背景协调的篡改物体的问题,本研究提出Disharmony Network,结合协调数据与分割模型,在聚合数据集上表现优于现有取证网络,还可检测虚拟试穿等多种编辑形式。
摘要:
基于深度学习的内容生成与篡改方法已取得显著进展,这使得检测图像是否被生成或编辑的技术需求日益增长。另一研究领域聚焦于图像中物体的插入与协调处理。本研究探索了将协调数据与分割模型结合以增强编辑图像区域检测能力的潜力,这类编辑既可以是人工制作的,也可以是通过深度学习方法生成的。研究结果表明,该方法能够有效识别此类编辑操作。现有取证模型往往忽略了对与背景相协调的插入物体的检测,而我们提出的Disharmony Network(不协调网络)填补了这一空白。通过使用整合了多种协调技术的聚合数据集,我们的模型在识别融入背景的协调物体方面表现优于现有取证网络,并且在检测包括虚拟试穿任务在内的多种编辑形式方面展现出潜力。
英文摘要:
Content generation and manipulation approaches based on deep learning methods have seen significant advancements, leading to an increased need for techniques to detect whether an image has been generated or edited. Another area of research focuses on the insertion and harmonization of objects within images. In this study, we explore the potential of using harmonization data in conjunction with a segmentation model to enhance the detection of edited image regions. These edits can be either manually crafted or generated using deep learning methods. Our findings demonstrate that this approach can effectively identify such edits. Existing forensic models often overlook the detection of harmonized objects in relation to the background, but our proposed Disharmony Network addresses this gap. By utilizing an aggregated dataset of harmonization techniques, our model outperforms existing forensic networks in identifying harmonized objects integrated into their backgrounds, and shows potential for detecting various forms of edits, including virtual try-on tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。