arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.08699cs.CV
收藏

低光照视频增强与有效的空间-时间分解范式

Low-Light Video Enhancement with An Effective Spatial-Temporal Decomposition Paradigm

Department of Computer Science and Engineering, The Chinese University of Hong Kong(计算机科学与工程系,香港中文大学);Shenzhen University(深圳大学);The University of Hong Kong(香港大学);camera group of DJI(大疆创新相机组);Zhejiang Normal University(浙江师范大学)

Xiaogang Xu, Kun Zhou, Tao Hu, Jiafei Wu, Ruixing Wang, Hao Peng, Bei Yu

AI总结:

本文提出视图感知低光照视频增强方法,通过引入双结构增强网络和残差项,提升视频增强与退化对应细化的性能。

摘要:

低光照视频增强(LLVE)旨在恢复受严重不可见性和噪声影响的动态或静态场景。在本文中,我们提出了一种创新的视频分解策略,结合了视图无关和视图相关的组件以提高LLVE的性能。该框架称为视图感知低光照视频增强(VLLVE)。我们利用动态跨帧对应关系来处理视图无关项(主要捕捉固有外观),并施加场景级连续性约束于视图相关项(主要描述光照条件)以实现一致且满意的分解结果。为了进一步确保一致的分解,我们引入了一个双结构增强网络,具有跨帧交互机制。通过同时监督不同帧,该网络鼓励它们表现出匹配的分解特征。这种机制可以无缝整合到编码器-解码器单帧网络中,带来极小的额外参数成本。基于VLLVE,我们提出了一种更全面的分解策略,通过引入一个附加残差项,从而得到VLLVE++。该残差项可以模拟场景自适应退化,这些退化难以用分解公式建模,从而进一步增强对视频整体内容的捕捉能力。此外,VLLVE++实现了增强和退化感知对应细化的双向学习(端到端方式),有效增加可靠对应关系并过滤掉错误的对应关系。值得注意的是,VLLVE++在处理具有挑战性的案例,如现实世界场景和高动态视频时表现出强大的能力。在广泛认可的LLVE基准上进行了大量实验。

英文摘要:

Low-Light Video Enhancement (LLVE) seeks to restore dynamic or static scenes plagued by severe invisibility and noise. In this paper, we present an innovative video decomposition strategy that incorporates view-independent and view-dependent components to enhance the performance of LLVE. The framework is called View-aware Low-light Video Enhancement (VLLVE). We leverage dynamic cross-frame correspondences for the view-independent term (which primarily captures intrinsic appearance) and impose a scene-level continuity constraint on the view-dependent term (which mainly describes the shading condition) to achieve consistent and satisfactory decomposition results. To further ensure consistent decomposition, we introduce a dual-structure enhancement network featuring a cross-frame interaction mechanism. By supervising different frames simultaneously, this network encourages them to exhibit matching decomposition features. This mechanism can seamlessly integrate with encoder-decoder single-frame networks, incurring minimal additional parameter costs. Building upon VLLVE, we propose a more comprehensive decomposition strategy by introducing an additive residual term, resulting in VLLVE++. This residual term can simulate scene-adaptive degradations, which are difficult to model using a decomposition formulation for common scenes, thereby further enhancing the ability to capture the overall content of videos. In addition, VLLVE++ enables bidirectional learning for both enhancement and degradation-aware correspondence refinement (end-to-end manner), effectively increasing reliable correspondences while filtering out incorrect ones. Notably, VLLVE++ demonstrates strong capability in handling challenging cases, such as real-world scenes and videos with high dynamics. Extensive experiments are conducted on widely recognized LLVE benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑