arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2602.21917cs.CV

扫描簇,而非像素:一种以簇为中心的高效超高清图像修复范式

Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restoration

National University of Defense Technology(国防科技大学);HKUST(GZ)(香港理工大学);Qilu University of Technology(青岛科技大学);Technical University of Munich(慕尼黑技术大学);TeleAI, China Telecom(TeleAI,中国电信);Beihang University(北航)

Chen Wu, Ling Wang, Zhuoran Zheng, Yuning Cui, Zhixiong Yang, Xiangyu Chen, Yue Zhang, Weidong Jiang, Jingyuan Xia

AI总结:

本文提出C$^2$SSM,通过簇串行扫描替代像素串行扫描,实现超高清图像修复的高效处理,显著降低计算成本并取得新成果。

摘要:

超高清(UHD)图像修复面临可扩展性危机:现有模型受限于像素级操作,需不可持续的计算资源。尽管状态空间模型(SSMs)如Mamba承诺线性复杂度,其像素串行扫描仍是处理数百万像素UHD内容的根本瓶颈。本文提出C$^2$SSM,一种视觉状态空间模型,通过从像素串行转向簇串行扫描打破这一限制。核心发现是,UHD图像的丰富特征分布可通过神经参数化混合模型浓缩为稀疏的语义质心。C$^2$SSM利用此方法将全局建模转化为新的双路径过程:首先扫描并推理少量簇中心,然后通过原理化的相似性分布将全局上下文扩散回所有像素,同时轻量级调制器保持细节。这种以簇为中心的范式在效率上取得突破,降低计算成本并在五个UHD修复任务中建立新的最佳结果。C$^2$SSM不仅是一个解决方案,更为高效大规模视觉开辟了新道路:扫描簇,而非像素。

英文摘要:

Ultra-High-Definition (UHD) image restoration is trapped in a scalability crisis: existing models, bound to pixel-wise operations, demand unsustainable computation. While state space models (SSMs) like Mamba promise linear complexity, their pixel-serial scanning remains a fundamental bottleneck for the millions of pixels in UHD content. We ask: must we process every pixel to understand the image? This paper introduces C$^2$SSM, a visual state space model that breaks this taboo by shifting from pixel-serial to cluster-serial scanning. Our core discovery is that the rich feature distribution of a UHD image can be distilled into a sparse set of semantic centroids via a neural-parameterized mixture model. C$^2$SSM leverages this to reformulate global modeling into a novel dual-path process: it scans and reasons over a handful of cluster centers, then diffuses the global context back to all pixels through a principled similarity distribution, all while a lightweight modulator preserves fine details. This cluster-centric paradigm achieves a decisive leap in efficiency, slashing computational costs while establishing new state-of-the-art results across five UHD restoration tasks. More than a solution, C$^2$SSM charts a new course for efficient large-scale vision: scan clusters, not pixels.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑