arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.04273cs.CV
收藏

使用无反射仅闪光提示的鲁棒反射消除

Robust Reflection Removal with Reflection-free Flash-only Cues

The Hong Kong University of Science and Technology(香港科技大学)

Chenyang Lei, Qifeng Chen

摘要:

我们提出了一个简单而有效的无反射提示强大的反射去除闪光灯和环境(无闪光灯)的图像对。无反射提示利用通过从原始数据空间中的对应闪光图像减去环境图像而获得的仅闪光图像。仅闪光灯的图像相当于在黑暗环境中拍摄的图像,我们观察到这种仅闪光灯的图像在视觉上是无反射的,因此它可以提供鲁棒的线索来推断环境图像中的反射。由于只有闪光灯的图像通常有文物,我们进一步提出了一个专用的模型,不仅利用反射免费的线索,但也避免引入文物,这有助于准确地估计反射和传输。我们对具有各种类型反射的真实世界图像的实验证明了我们的模型与无反射仅闪光提示的有效性:我们的模型在PSNR中超过5.23dB,在SSIM中超过0.04,在LPIPS中超过0.068。我们的源代码和数据集在{github.com/ChenyangLEI/flash-reflection-removal}上公开。

英文摘要:

We propose a simple yet effective reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. The reflection-free cue exploits a flash-only image obtained by subtracting the ambient image from the corresponding flash image in raw data space. The flash-only image is equivalent to an image taken in a dark environment with only a flash on. We observe that this flash-only image is visually reflection-free, and thus it can provide robust cues to infer the reflection in the ambient image. Since the flash-only image usually has artifacts, we further propose a dedicated model that not only utilizes the reflection-free cue but also avoids introducing artifacts, which helps accurately estimate reflection and transmission. Our experiments on real-world images with various types of reflection demonstrate the effectiveness of our model with reflection-free flash-only cues: our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR, 0.04 in SSIM, and 0.068 in LPIPS. Our source code and dataset are publicly available at {github.com/ChenyangLEI/flash-reflection-removal}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑