arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.08073cs.CV

超越雾霾:生成式夜间图像去雾

Seeing Beyond Haze: Generative Nighttime Image Dehazing

National University of Singapore(新加坡国立大学);Microsoft Research Asia(微软亚洲研究院)

Beibei Lin, Stephen Lin, Robby Tan

AI总结:

BeyondHaze通过生成式模型提升夜间图像去雾效果,结合强背景先验和引导训练,实现雾霾和光晕下的清晰重建。

摘要:

夜间图像去雾尤其具有挑战性,当密集的雾霾和强烈的光晕严重降级或完全遮蔽背景信息时。现有方法往往难以应对,因为背景先验知识不足和生成能力有限,这两种因素在这样的条件下尤为重要。在本文中,我们介绍了BeyondHaze,一种生成式夜间去雾方法,不仅减少了雾和光晕效果,还能够在视觉线索严重降级的区域中重建合理的背景结构。我们的方法基于两个主要思想:通过适应图像扩散模型进行夜间去雾来获得强背景先验知识,以及通过引导训练增强在雾和光晕遮蔽区域的生成能力。任务特定的夜间去雾知识被提炼成图像扩散模型,同时保持其生成清晰图像的能力。扩散模型进一步在定制图像对上进行训练,以提高其恢复被雾霾抑制的背景细节的能力。由于生成模型可能会引入幻觉内容,我们设计了我们的框架,允许用户控制生成水平,以在视觉真实性和保真度之间取得平衡。在真实世界的夜间图像上的实验表明,BeyondHaze在密集雾霾下显著提高了可见性和场景细节。

英文摘要:

Nighttime image dehazing is particularly challenging when dense haze and intense glow severely degrade or entirely obscure background information. Existing methods often struggle due to insufficient background priors and limited generative capability, both of which are highly important under such conditions. In this paper, we introduce BeyondHaze, a generative nighttime dehazing method that not only reduces haze and glow effects but also reconstructs plausible background structures in regions where visual cues are heavily degraded. Our approach is built on two main ideas: obtaining strong background priors by adapting image diffusion models to nighttime dehazing, and enhancing generative ability in haze- and glow-obscured areas through guided training. Task-specific nighttime dehazing knowledge is distilled into an image diffusion model while preserving its capacity to generate clean images. The diffusion model is further trained on tailored image pairs to improve its ability to recover background details that are suppressed by haze effects. Since generative models may introduce hallucinated content, we design our framework to allow user control over the generative level, enabling a balance between visual realism and fidelity. Experiments on real-world nighttime images demonstrate that BeyondHaze substantially improves visibility and scene detail under dense haze.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑