arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.03984cs.CV

高保真壁画修复的统一混合掩码感知变换器

High-Fidelity Mural Restoration via a Unified Hybrid Mask-Aware Transformer

Northeastern University (Toronto Campus)(东北大学(多伦多校区));The Bishop Strachan School(主教斯特拉坎学校)

Jincheng Jiang, Qianhao Han, Chi Zhang, Zheng Zheng

AI总结:

本文提出混合掩码感知变换器HMAT,通过结合掩码感知动态过滤与Transformer瓶颈,实现壁画的高保真修复,同时通过掩码条件风格融合模块和教师强迫解码器提升修复效果。

摘要:

古代壁画是重要的文化遗存,但许多因环境暴露、材料老化和人类活动而严重退化。修复这些艺术品极具挑战性,需重建缺失结构并严格保护未受损区域。本文提出了混合掩码感知变换器(HMAT),一个统一的高保真壁画修复框架。HMAT整合了掩码感知动态过滤用于稳健的局部纹理建模,以及Transformer瓶颈用于长距离结构推断。为进一步处理退化形态的多样性,我们引入了掩码条件风格融合模块,动态指导生成过程。此外,设计了教师强迫解码器与硬门控跳跃连接,以在有效区域强制保真度并在缺失区域聚焦重建。我们在DHMural数据集和精选的九色 Deer 数据集上评估HMAT,在不同退化水平下进行测试。实验结果表明,所提方法在与最先进方法相比时表现竞争,同时产生更具结构一致性和视觉忠实性的修复结果。这些发现表明,HMAT为文化遗存壁画的数字修复提供了有效解决方案。

英文摘要:

Ancient murals are valuable cultural artifacts, but many have suffered severe degradation due to environmental exposure, material aging, and human activity. Restoring these artworks is challenging because it requires both reconstructing large missing structures and preserving authentic, undamaged regions. We present the Hybrid Mask-Aware Transformer (HMAT), a unified framework for high-fidelity mural restoration that addresses both structural completion and authentic-region preservation. HMAT integrates Mask-Aware Dynamic Filtering for robust local texture modeling with a Transformer bottleneck for long-range structural inference, enabling recovery of continuous line patterns and coherent mural structures under irregular damage. To handle diverse degradation morphologies, we introduce a mask-conditional style fusion module that adapts the generative process according to the shape and extent of missing regions. We also propose a fidelity-oriented training objective that combines hole-normalized reconstruction, discriminator feature matching, and high-receptive-field perceptual supervision to improve damaged-region fidelity, texture consistency, and boundary quality. In addition, we analyze a Teacher-Forcing Decoder with hard-gated skip connections as a feature-space boundary-conditioning strategy. Experiments show that HMAT matches or outperforms representative convolutional, transformer-based, and edge-guided inpainting baselines, with especially strong gains in perceptual realism and severe-mask settings. Ablation studies further identify the proposed objective, MADF-based mask-aware encoding, and mask-conditioned synthesis as the main contributors to restoration quality. These results demonstrate that HMAT provides an effective and competitive solution for cultural heritage mural restoration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑