arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.00533cs.CV

全场景视频修复应对平滑演变的未知天气退化

All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations

Department of Computer Science and Technology, Harbin Institute of Technology(计算机科学与技术系,哈尔滨工业大学);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国);School of Computer Science, Peking University(计算机学院,北京大学)

Wenrui Li, Hongtao Chen, Yao Xiao, Wangmeng Zuo, Jiantao Zhou, Yonghong Tian, Xiaopeng Fan

AI总结:

本文提出ORCANet网络,针对平滑演变的未知天气退化问题,通过递归条件和适应提示机制实现视频修复的高质量与时序一致性。

摘要:

全场景图像修复旨在利用单一模型从多种未知退化中恢复清晰图像。但将此任务扩展到视频面临独特挑战。现有方法主要关注帧级退化变化,忽略了现实世界退化过程中自然存在的时序连续性。实际上,退化类型和强度随时间平滑演变,且多种退化可能共存或逐渐过渡。在本文中,我们引入了平滑演变未知退化(SEUD)场景,其中活跃的退化集合和退化强度随时间连续变化。为支持此场景,我们设计了灵活的合成管道,生成具有单个、复合和演变退化的时序连贯视频。为解决SEUD场景中的挑战,我们提出了全场景递归条件和适应提示网络(ORCANet)。首先,粗强度估计去雾(CIED)模块利用物理先验估计雾强度,并提供粗去雾特征作为初始化。其次,流提示生成(FPG)模块提取退化特征。FPG生成静态提示以捕捉段级退化类型和动态提示以适应帧级强度变化。此外,标签感知监督机制提高了静态提示表示在不同退化下的辨别能力。大量实验表明,ORCANet在图像和视频基准上实现了更优的修复质量、时序一致性和鲁棒性。代码可在https://github.com/Friskknight/ORCANet-SEUD获取。

英文摘要:

All-in-one image restoration aims to recover clean images from diverse unknown degradations using a single model. But extending this task to videos faces unique challenges. Existing approaches primarily focus on frame-wise degradation variation, overlooking the temporal continuity that naturally exists in real-world degradation processes. In practice, degradation types and intensities evolve smoothly over time, and multiple degradations may coexist or transition gradually. In this paper, we introduce the Smoothly Evolving Unknown Degradations (SEUD) scenario, where both the active degradation set and degradation intensity change continuously over time. To support this scenario, we design a flexible synthesis pipeline that generates temporally coherent videos with single, compound, and evolving degradations. To address the challenges in the SEUD scenario, we propose an all-in-One Recurrent Conditional and Adaptive prompting Network (ORCANet). First, a Coarse Intensity Estimation Dehazing (CIED) module estimates haze intensity using physical priors and provides coarse dehazed features as initialization. Second, a Flow Prompt Generation (FPG) module extracts degradation features. FPG generates both static prompts that capture segment-level degradation types and dynamic prompts that adapt to frame-level intensity variations. Furthermore, a label-aware supervision mechanism improves the discriminability of static prompt representations under different degradations. Extensive experiments show that ORCANet achieves superior restoration quality, temporal consistency, and robustness over image and video-based baselines. Code is available at https://github.com/Friskknight/ORCANet-SEUD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑