arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.10707cs.CVcs.MM
收藏

神经成像管道--法医学的灾难还是希望?

Neural Imaging Pipelines - the Scourge or Hope of Forensics?

Tandon School of Engineering, New York University(纽约大学坦登工程学院);AGH University of Science and Technology(AGH科技大学)

Pawel Korus, Nasir Memon

摘要:

数字照片的法医分析依赖于在其获取或随后编辑时引入的内在统计痕迹。这种迹线通常通过后处理(例如,在网络中分发时应用下采样和再压缩),这抑制了可靠的来源分析。在数码相机中越来越多地采用计算方法进一步使该过程复杂化,并且使得明确的数学建模不可行。虽然这一趋势对法医分析提出了挑战,即使在接近收购的条件下,它也创造了新的机会。本文探讨了整个图像采集和分发工作流程的端到端优化,以促进在最先进的取证技术无法实现的分发渠道末端进行可靠的取证分析。我们证明了一个神经网络可以被训练来取代整个照片开发管道,并联合优化高保真照片渲染和可靠的出处分析。这种优化的神经成像管道使我们能够将图像处理检测精度从大约45%到90%以上。该网络学习引入精心制作的工件,类似于数字水印,这有助于随后的操纵检测。性能权衡的分析表明,大部分的增益可以获得只有轻微的失真。研究结果鼓励进一步研究,以建立更可靠的成像管道,具有明确的出处保证属性。

英文摘要:

Forensic analysis of digital photographs relies on intrinsic statistical traces introduced at the time of their acquisition or subsequent editing. Such traces are often removed by post-processing (e.g., down-sampling and re-compression applied upon distribution in the Web) which inhibits reliable provenance analysis. Increasing adoption of computational methods within digital cameras further complicates the process and renders explicit mathematical modeling infeasible. While this trend challenges forensic analysis even in near-acquisition conditions, it also creates new opportunities. This paper explores end-to-end optimization of the entire image acquisition and distribution workflow to facilitate reliable forensic analysis at the end of the distribution channel, where state-of-the-art forensic techniques fail. We demonstrate that a neural network can be trained to replace the entire photo development pipeline, and jointly optimized for high-fidelity photo rendering and reliable provenance analysis. Such optimized neural imaging pipeline allowed us to increase image manipulation detection accuracy from approx. 45% to over 90%. The network learns to introduce carefully crafted artifacts, akin to digital watermarks, which facilitate subsequent manipulation detection. Analysis of performance trade-offs indicates that most of the gains can be obtained with only minor distortion. The findings encourage further research towards building more reliable imaging pipelines with explicit provenance-guaranteeing properties.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑