arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.06334cs.CV
收藏

基于直方图 Transformer 特征增强的多天气图像复原

Multi-Weather Image Restoration via Histogram-Based Transformer Feature Enhancement

School of Electronic and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);Shanghai Jiao Tong University(上海交通大学)

Yang Wen, Anyu Lai, Bo Qian, Hao Wang, Wuzhen Shi, Wenming Cao

AI总结:

针对未知混合天气下的图像复原需求,本文提出结合任务序列生成器、任务块内模块与基于直方图的 transformer 主干的模型,以提取任务特征并捕获全局、局部动态范围信息,在公开数据集上达到最先进性能。

摘要:

当前,恶劣天气条件下的主流复原任务主要集中于单一天气场景。然而在现实中,多种天气状况往往同时存在,且其混合程度通常是未知的。在这种复杂多样的天气条件下,单一天气复原模型难以满足实际需求。这在自动驾驶等领域尤为关键,这些领域迫切需要一种能够有效处理混合天气条件并以自动化方式增强图像质量的模型。本文提出一个 Task Sequence Generator(任务序列生成器)模块,该模块与 Task Intra-patch Block(任务块内模块)协同工作,可有效提取退化图像中嵌入的任务特定特征。Task Intra-patch Block 引入外部可学习序列,帮助网络捕获任务特定信息。此外,我们采用基于直方图的 transformer 模块作为网络主干,从而能够同时捕获全局和局部动态范围特征。所提出的模型在公开数据集上取得了 state-of-the-art(最先进)性能。

英文摘要:

Currently, the mainstream restoration tasks under adverse weather conditions have predominantly focused on single-weather scenarios. However, in reality, multiple weather conditions always coexist and their degree of mixing is usually unknown. Under such complex and diverse weather conditions, single-weather restoration models struggle to meet practical demands. This is particularly critical in fields such as autonomous driving, where there is an urgent need for a model capable of effectively handling mixed weather conditions and enhancing image quality in an automated manner. In this paper, we propose a Task Sequence Generator module that, in conjunction with the Task Intra-patch Block, effectively extracts task-specific features embedded in degraded images. The Task Intra-patch Block introduces an external learnable sequence that aids the network in capturing task-specific information. Additionally, we employ a histogram-based transformer module as the backbone of our network, enabling the capture of both global and local dynamic range features. Our proposed model achieves state-of-the-art performance on public datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑