Ancient murals are valuable cultural artifacts, but many have suffered severe degradation due to environmental exposure, material aging, and human activity. Restoring these artworks is challenging because it requires both reconstructing large missing structures and preserving authentic, undamaged regions. We present the Hybrid Mask-Aware Transformer (HMAT), a unified framework for high-fidelity mural restoration that addresses both structural completion and authentic-region preservation. HMAT integrates Mask-Aware Dynamic Filtering for robust local texture modeling with a Transformer bottleneck for long-range structural inference, enabling recovery of continuous line patterns and coherent mural structures under irregular damage. To handle diverse degradation morphologies, we introduce a mask-conditional style fusion module that adapts the generative process according to the shape and extent of missing regions. We also propose a fidelity-oriented training objective that combines hole-normalized reconstruction, discriminator feature matching, and high-receptive-field perceptual supervision to improve damaged-region fidelity, texture consistency, and boundary quality. In addition, we analyze a Teacher-Forcing Decoder with hard-gated skip connections as a feature-space boundary-conditioning strategy. Experiments show that HMAT matches or outperforms representative convolutional, transformer-based, and edge-guided inpainting baselines, with especially strong gains in perceptual realism and severe-mask settings. Ablation studies further identify the proposed objective, MADF-based mask-aware encoding, and mask-conditioned synthesis as the main contributors to restoration quality. These results demonstrate that HMAT provides an effective and competitive solution for cultural heritage mural restoration.
CMAMRNet: A Contextual Mask-Aware Network Enhancing Mural Restoration Through Comprehensive Mask Guidance
University of Macau(澳门大学);Guangdong University of Technology(广东工业大学);University of Chinese Academy of Sciences(中国科学院大学);Shanghai Jiao Tong University(上海交通大学);Shenzhen Polytechnic University(深圳职业技术大学)
DiffuMural: Restoring Dunhuang Murals with Multi-scale Diffusion
Southern University of Science and Technology(南方科技大学);Beijing Normal University(北京师范大学);Hebei Guoyan Science and Technology Center(河北国研科技中心);Wuhan University(武汉大学);The Australian National University(澳大利亚国立大学);AI Geeks;Zhejiang University(浙江大学);Zhejiang Lab(之江实验室)
Restora-Flow: Mask-Guided Image Restoration with Flow Matching
Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz(格拉茨医科大学医学信息学、统计学与文献研究所);Division of Medical Physics and Biophysics, Medical University of Graz(格拉茨医科大学医学物理与生物物理部);Institute of Visual Computing, Graz University of Technology(格拉茨技术大学视觉计算研究所);Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系)
NeRF-MIR: Towards High-Quality Restoration of Masked Images with Neural Radiance Fields
Shanghai Key Lab of Intelligent Information Processing(上海智能信息处理重点实验室);College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院)
University of Science and Technology of China(中国科学技术大学)
The key to shadow removal is recovering the contents of the shadow regions with the guidance of the non-shadow regions. Due to the inadequate long-range modeling, the CNN-based approaches cannot thoroughly investigate the information from the non-shadow regions. To solve this problem, we propose a novel cleanness-navigated-shadow network (CNSNet), with a shadow-oriented adaptive normalization (SOAN) module and a shadow-aware aggregation with transformer (SAAT) module based on the shadow mask. Under the guidance of the shadow mask, the SOAN module formulates the statistics from the non-shadow r…
Multi-feature Reconstruction Network using Crossed-mask Restoration for Unsupervised Industrial Anomaly Detection
School of Information and Communication Engineering, Zhongyuan University of Technology(中原工学院信息与通信工程学院);College of Automation Engineering, Nanjing University of Aeronautics and Astronautics(南京航空航天大学自动化学院);Applied Technology Research Institute, Henan Institute of Economics and Trade(河南经贸职业学院应用技术研究院)
Image restoration is the task of recovering a clean image from a degraded version. In most cases, the degradation is spatially varying, and it requires the restoration network to both localize and restore the affected regions. In this paper, we present a new approach suitable for handling the image-specific and spatially-varying nature of degradation in images affected by practically occurring artifacts such as blur, rain-streaks. We decompose the restoration task into two stages of degradation localization and degraded region-guided restoration, unlike existing methods which directly learn a …
Georgia Institute of Technology(佐治亚理工学院);Apple(苹果公司)
Generative adversarial networks (GANs), trained on a large-scale image dataset, can be a good approximator of the natural image manifold. GAN-inversion, using a pre-trained generator as a deep generative prior, is a promising tool for image restoration under corruptions. However, the performance of GAN-inversion can be limited by a lack of robustness to unknown gross corruptions, i.e., the restored image might easily deviate from the ground truth. In this paper, we propose a Robust GAN-inversion (RGI) method with a provable robustness guarantee to achieve image restoration under unknown \texti…
The Chinese University of Hong Kong(香港中文大学);Tencent PCG(腾讯平台与内容事业群);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Nanyang Technological University(南洋理工大学)
Very deep Convolutional Neural Networks (CNNs) have greatly improved the performance on various image restoration tasks. However, this comes at a price of increasing computational burden, hence limiting their practical usages. We observe that some corrupted image regions are inherently easier to restore than others since the distortion and content vary within an image. To leverage this, we propose Path-Restore, a multi-path CNN with a pathfinder that can dynamically select an appropriate route for each image region. We train the pathfinder using reinforcement learning with a difficulty-regulat…
AgileIR: Memory-Efficient Group Shifted Windows Attention for Agile Image Restoration
Faculty of Computer Science;Information Technology University of Malaya Kuala Lumpur, Malaysia;School of Intelligence Science;Technology University of Science;Faculty of Art;Design Fuzhou University of International Studies
Bahcesehir University(巴耶塞特大学);American University of Malta(马耳他美国大学)
Realistic image restoration with high texture areas such as removing face masks is challenging. The state-of-the-art deep learning-based methods fail to guarantee high-fidelity, cause training instability due to vanishing gradient problems (e.g., weights are updated slightly in initial layers) and spatial information loss. They also depend on intermediary stage such as segmentation meaning require external mask. This paper proposes a blind mask face inpainting method using residual attention UNet to remove the face mask and restore the face with fine details while minimizing the gap with the g…
Missing Data Estimation for MR Spectroscopic Imaging via Mask-Free Deep Learning Methods
Florida Institute of Technology(佛罗里达理工学院);Massachusetts General Hospital, Harvard Medical School, USA(麻省总医院、哈佛医学院、美国);A. A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, USA(A.A. Martinos生物医学成像中心、放射科、麻省总医院、哈佛医学院、美国);Department of Mathematics and Systems Engineering, Florida Institute of Technology, USA(数学与系统工程系、佛罗里达理工学院、美国);Department of Mechanical and Civil Engineering, Florida Institute of Technology, USA(机械与土木工程系、佛罗里达理工学院、美国)
Digital scans of analogue photographic film typically contain artefacts such as dust and scratches. Automated removal of these is an important part of preservation and dissemination of photographs of historical and cultural importance. While state-of-the-art deep learning models have shown impressive results in general image inpainting and denoising, film artefact removal is an understudied problem. It has particularly challenging requirements, due to the complex nature of analogue damage, the high resolution of film scans, and potential ambiguities in the restoration. There are no publicly av…
Motion-Aware Adaptive Pixel Pruning for Efficient Local Motion Deblurring
Harbin Institute of Technology \& City University of Hong Kong;School of Computer Science;Technology, Harbin Institute of Technology;Tianjin University \& Low-Altitude Intelligence Lab, Xiong'an National Innovation Center Technology Co., Ltd;College of Intelligence;Computing, Tianjin University
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shenzhen Institute of Future Media Technology(深圳未来媒体技术研究院);Westlake University(西湖大学);ETH Zürich(苏黎世联邦理工学院)
Hyperspectral image (HSI) reconstruction aims to recover the 3D spatial-spectral signal from a 2D measurement in the coded aperture snapshot spectral imaging (CASSI) system. The HSI representations are highly similar and correlated across the spectral dimension. Modeling the inter-spectra interactions is beneficial for HSI reconstruction. However, existing CNN-based methods show limitations in capturing spectral-wise similarity and long-range dependencies. Besides, the HSI information is modulated by a coded aperture (physical mask) in CASSI. Nonetheless, current algorithms have not fully expl…
Hong Kong Baptist University(香港浸会大学);Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究院);vivo Mobile Communication Co. Ltd(维沃移动通信有限公司);City University of Hong Kong(香港城市大学);Nanyang Technological University(南洋理工大学)
High Dynamic Range (HDR) imaging via multi-exposure fusion is an important task for most modern imaging platforms. In spite of recent developments in both hardware and algorithm innovations, challenges remain over content association ambiguities caused by saturation, motion, and various artifacts introduced during multi-exposure fusion such as ghosting, noise, and blur. In this work, we propose an Attention-guided Progressive Neural Texture Fusion (APNT-Fusion) HDR restoration model which aims to address these issues within one framework. An efficient two-stream structure is proposed which sep…
Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion
School of Computer Science, Wuhan University, China(武汉大学计算机学院);The Central Hospital of Wuhan, China(武汉市中心医院);School of Computer Science, Hubei University of Technology, China(湖北工业大学计算机学院)
Sea-Undistort: A Dataset for Through-Water Image Restoration in High Resolution Airborne Bathymetric Mapping
Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin(电气工程与计算机科学系,柏林技术大学);Berlin Institute for the Foundations of Learning and Data (BIFOLD)(学习与数据基础研究院(BIFOLD))
MESA: A Training-Free Multi-Exemplar Deep Framework for Restoring Ancient Inscription Textures
Department of Computer Science and Engineering(计算机科学与工程系);University of Ioannina(伊奥安纳大学);Inria Paris-Rocquencourt(巴黎-罗克琴堡研究所);Rajiv Gandhi University(拉朱·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
Reversible Unfolding Network for Concealed Visual Perception with Generative Refinement
Department of Biomedical Engineering, Duke University(生物医学工程系,杜克大学);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Nankai International Advanced Research Institute (SHENZHEN FUTIAN), Nankai University(南开国际先进研究院(深圳福田),南开大学);College of Computer Science, Nankai University(计算机科学学院,南开大学)