arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.18591cs.CV

无需参考的联合低光照增强与去模糊化:基于视觉自回归建模与VLM衍生调制

Zero-Reference Joint Low-Light Enhancement and Deblurring via Visual Autoregressive Modeling with VLM-Derived Modulation

Wei Dong, Han Zhou, Junwei Lin, Jun Chen

AI总结:

本文提出了一种无需参考的联合低光照增强与去模糊化方法,基于视觉自回归建模和VLM衍生调制,通过自适应曲线估计和动态旋转位置编码提升模型对模糊和光照变化的处理能力。

摘要:

现实中的暗图像不仅表现出低可见性和对比度,还存在复杂的噪声和模糊,给恢复带来了重大挑战。现有方法往往依赖配对数据或无法建模动态光照和模糊特性,导致泛化能力差。为此,我们提出了一种基于视觉自回归(VAR)建模的生成框架,受视觉语言模型(VLM)的感知先验指导。具体而言,为了为VAR模型提供信息丰富的条件线索,我们部署了自适应曲线估计方案,根据VLM衍生的可见性分数来调节多样的光照。此外,我们将动态和空间频率感知的旋转位置编码(SF-RoPE)整合到VAR中,以增强其对模糊退化结构的建模能力。进一步地,我们提出了一种递归相域调制策略,通过受VLM评估的模糊分数引导的有界迭代细化,减轻模糊引起的伪影。我们的框架完全无监督,并在基准数据集上实现了最先进的性能。

英文摘要:

Real-world dark images commonly exhibit not only low visibility and contrast but also complex noise and blur, posing significant restoration challenges. Existing methods often rely on paired data or fail to model dynamic illumination and blur characteristics, leading to poor generalization. To tackle this, we propose a generative framework based on visual autoregressive (VAR) modeling, guided by perceptual priors from the vision-language model (VLM). Specifically, to supply informative conditioning cues for VAR models, we deploy an adaptive curve estimation scheme to modulate the diverse illumination based on VLM-derived visibility scores. In addition, we integrate dynamic and spatial-frequency-aware Rotary Positional Encodings (SF-RoPE) into VAR to enhance its ability to model structures degraded by blur. Furthermore, we propose a recursive phase-domain modulation strategy that mitigates blur-induced artifacts in the phase domain via bounded iterative refinement guided by VLM-assessed blur scores. Our framework is fully unsupervised and achieves state-of-the-art performance on benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑