Dual-Hybrid Attention Network for Specular Highlight Removal
University of Macau(澳门大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Baoshan University(保山学院);Huizhou University(惠州学院)
Xiaojiao Guo, Xuhang Chen, Shenghong Luo, Shuqiang Wang, Chi-Man Pun
Specular highlight removal plays a pivotal role in multimedia applications, as it enhances the quality and interpretability of images and videos, ultimately improving the performance of downstream tasks such as content-based retrieval, object recognition, and scene understanding. Despite significant advances in deep learning-based methods, current state-of-the-art approaches often rely on additional priors or supervision, limiting their practicality and generalization capability. In this paper, we propose the Dual-Hybrid Attention Network for Specular Highlight Removal (DHAN-SHR), an end-to-end network that introduces novel hybrid attention mechanisms to effectively capture and process information across different scales and domains without relying on additional priors or supervision. DHAN-SHR consists of two key components: the Adaptive Local Hybrid-Domain Dual Attention Transformer (L-HD-DAT) and the Adaptive Global Dual Attention Transformer (G-DAT). The L-HD-DAT captures local inter-channel and inter-pixel dependencies while incorporating spectral domain features, enabling the network to effectively model the complex interactions between specular highlights and the underlying surface properties. The G-DAT models global inter-channel relationships and long-distance pixel dependencies, allowing the network to propagate contextual information across the entire image and generate more coherent and consistent highlight-free results. To evaluate the performance of DHAN-SHR and facilitate future research in this area, we compile a large-scale benchmark dataset comprising a diverse range of images with varying levels of specular highlights. Through extensive experiments, we demonstrate that DHAN-SHR outperforms 18 state-of-the-art methods both quantitatively and qualitatively, setting a new standard for specular highlight removal in multimedia applications.
Shift-Window Meets Dual Attention: A Multi-Model Architecture for Specular Highlight Removal
College of Mechanical and Vehicle Engineering, Chongqing University(重庆大学机械与车辆工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Artificial Intelligence Center, Geely Automotive Research Institute(吉利汽车研究院人工智能中心)
Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data
The Hong Kong Polytechnic University(香港理工大学);Sun Yat-sen University(中山大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Wuhan University(武汉大学)
Learning to Remove Wrinkled Transparent Film with Polarized Prior
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));SmartMore Corporation(旷世科技公司);Zhejiang University(浙江大学);Zhejiang Lab(浙江大学实验室)
Single Document Image Highlight Removal via A Large-Scale Real-World Dataset and A Location-Aware Network
College of Computer Science, Jilin University(吉林大学计算机科学学院);Institute of Information Science, Academia Sinica(中国科学院信息科学研究院);National Yang Ming Chiao Tung University(阳明交通大学);National Taiwan University(台湾大学)
A Highlight Removal Method for Capsule Endoscopy Images
School of Artificial Intelligence and Computer Science, Jiangnan University(江南大学人工智能与计算机学院);Engineering Research Center of Intelligent Technology for Healthcare, Ministry of Education(教育部智慧医疗技术工程研究中心)
High-Fidelity Document Stain Removal via A Large-Scale Real-World Dataset and A Memory-Augmented Transformer
School of Computer Science and Engineering, Huizhou University(惠州学院计算机科学与工程学院);Faculty of Science and Technology, University of Macau(澳门大学科技学院);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);School of Electronic and Communication Engineering, Shenzhen Polytechnic University(深圳职业技术学院电子与通信工程学院)
Tunable Wavelet Unit based Convolutional Neural Network in Optical Coherence Tomography Analysis Enhancement for Classifying Type of Epiretinal Membrane Surgery
University of California San Diego(加州大学圣迭戈分校);Jacobs Retina Center(雅各布视网膜中心)