arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.17991cs.CV

PolUR:面向水下图像复原的偏振感知多模态退化感知方法

PolUR: Polarization Aware Multimodal Degradation Perception for Underwater Image Restoration

Northeastern University(东北大学)

Wenshuo Zhang, Xiangyue Zhang, Junlin Li, Wenjie Tian, Yubo Zheng, Hongli Xu, Jingyu Ru, Xinde Li

AI总结:

针对水下图像混合退化问题,提出多模态语言驱动框架PolUR,构建MixPolar基准验证其能有效整合偏振与RGB信息,在退化感知、图像复原及下游任务中表现优异。

摘要:

从退化的水下观测中恢复高质量图像对水下勘探至关重要。偏振观测有望成为在清水条件下恢复目标辐射度的有效互补物理线索。然而,现有方法尚未能联合建模原始强度信息与偏振线索,以实现由混合退化(色偏、 haze、低光照)理解驱动的图像复原。为克服这些局限,我们提出PolUR,一种统一的多模态语言驱动框架,该框架联合利用偏振与RGB信息,通过结构化语义指令识别退化类型与严重程度,并在感知退化的语义特征引导下增强联合复原表征,以提升混合退化下的复原鲁棒性。我们进一步构建了名为MixPolar的新基准,其包含呈现真实世界退化的水下图像及其对应的退化描述,支持对退化感知、图像复原及下游任务性能的系统评估。大量实验表明,PolUR能有效整合偏振与RGB信息,在退化感知与图像复原中取得具有竞争力的性能,同时展现出泛化能力及对下游任务的实用性。

英文摘要:

Recovering high-quality images from degraded underwater observations is crucial for underwater exploration. Polarization observations show promise as an effective source of complementary physical cues for recovering target radiance under clear-water conditions. However, existing methods have yet to jointly model raw intensity information and polarization cues to enable image restoration driven by an understanding of mixed degradations (color casts, haze, and low light). To overcome these limitations, we propose PolUR, a unified multimodal language-driven framework that jointly uses polarization and RGB information to identify degradation types and severity levels through structured semantic instructions and enhances joint restoration representations under the guidance of degradation-aware semantic features to improve restoration robustness under mixed degradations. We further construct a new benchmark named MixPolar, which contains underwater images exhibiting real-world degradations and their corresponding degradation descriptions. MixPolar supports systematic evaluation of degradation perception, image restoration, and performance on downstream tasks. Extensive experiments demonstrate that PolUR effectively integrates polarization and RGB information, achieving competitive performance in degradation perception and image restoration, while also demonstrating generalization capability and utility for downstream tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑