arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.10286cs.CVcs.AI

Enlighten Anything:当 Segment Anything Model 遇上低照度图像增强

Enlighten Anything: When Segment Anything Model Meets Low-Light Image Enhancement

Qihan Zhao, Xiaofeng Zhang, Hao Tang, Chaochen Gu, Shanying Zhu

AI总结:

本文提出 Enlighten-anything 方法,将 SAM 分割的语义意图与低照度图像融合以提升视觉感知,在 LOL 数据集上 PSNR 提升 3dB、SSIM 提升 8,显著增强了无监督低照度增强的泛化能力。

摘要:

图像恢复是低级视觉任务,大多数 CNN 方法被设计为黑盒,缺乏透明性和内在美学。许多无监督方法忽略了低照度场景中可见信息的退化,这将严重影响互补信息的聚合,也使融合算法在极端条件下无法产生令人满意的融合结果。本文提出 Enlighten-anything,能够将 SAM 分割的语义意图与低照度图像进行增强和融合,以获得具有良好视觉感知的融合图像。无监督学习的泛化能力得到极大提升,在 LOL 数据集上的实验表明,我们的方法在 PSNR 上比基线提升了 3dB,在 SSIM 上提升了 8。SAM 的零样本学习为无监督低照度增强引入了强大辅助。Enlighten Anything 的源代码可从 https://github.com/zhangbaijin/enlighten-anything 获取。

英文摘要:

Image restoration is a low-level visual task, and most CNN methods are designed as black boxes, lacking transparency and intrinsic aesthetics. Many unsupervised approaches ignore the degradation of visible information in low-light scenes, which will seriously affect the aggregation of complementary information and also make the fusion algorithm unable to produce satisfactory fusion results under extreme conditions. In this paper, we propose Enlighten-anything, which is able to enhance and fuse the semantic intent of SAM segmentation with low-light images to obtain fused images with good visual perception. The generalization ability of unsupervised learning is greatly improved, and experiments on LOL dataset are conducted to show that our method improves 3db in PSNR over baseline and 8 in SSIM. Zero-shot learning of SAM introduces a powerful aid for unsupervised low-light enhancement. The source code of Enlighten Anything can be obtained from https://github.com/zhangbaijin/enlighten-anything

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑