Convolutional neural network (CNN)-based image denoising methods typically estimate the noise component contained in a noisy input image and restore a clean image by subtracting the estimated noise from the input. However, previous denoising methods tend to remove high-frequency information (e.g., textures) from the input. It caused by intermediate feature maps of CNN contains texture information. A straightforward approach to this problem is stacking numerous layers, which leads to a high computational cost. To achieve high performance and computational efficiency, we propose a gated texture CNN (GTCNN), which is designed to carefully exclude the texture information from each intermediate feature map of the CNN by incorporating gating mechanisms. Our GTCNN achieves state-of-the-art performance with 4.8 times fewer parameters than previous state-of-the-art methods. Furthermore, the GTCNN allows us to interactively control the texture strength in the output image without any additional modules, training, or computational costs.
Gated Multi-Resolution Transfer Network for Burst Restoration and Enhancement
Indian Institute of Technology Ropar（印度理工学院鲁尔基分校）；Mohamed bin Zayed University of AI（穆罕默德·本·扎耶德人工智能大学）；Inception Institute of AI（起源人工智能研究院）；Australian National University（澳大利亚国立大学）；Linköping University（林雪平大学）
Revisiting Global Token Mixing in Task-Dependent MRI Restoration: Insights from Minimal Gated CNN Baselines
Dept. of Radiology & Imaging Sciences, University of Utah, Salt Lake City, UT, USA（放射学与成像科学系，犹他大学，盐湖城，UT，USA）；Dept. of Electrical & Computer Engineering, University of Utah, Salt Lake City, UT, USA（电气与计算机工程系，犹他大学，盐湖城，UT，USA）；Dept. of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE（计算机视觉系，莫扎德人工智能大学，阿布扎赫，EUA）；Dept. of Biomedical Engineering, University of Utah, Salt Lake City, UT, USA（生物医学工程系，犹他大学，盐湖城，UT，USA）；Dept. of Electrical & Computer Engineering, University of Washington, Seattle, WA, USA（电气与计算机工程系，华盛顿大学，西雅图，WA，USA）
Current video denoising methods perform temporal fusion by designing convolutional neural networks (CNN) or combine spatial denoising with temporal fusion into basic recurrent neural networks (RNNs). However, there have not yet been works which adapt gated recurrent unit (GRU) mechanisms for video denoising. In this letter, we propose a new video denoising model based on GRU, namely GRU-VD. First, the reset gate is employed to mark the content related to the current frame in the previous frame output. Then the hidden activation works as an initial spatial-temporal denoising with the help from …
Gating is commonly used in PET imaging to reduce respiratory motion blurring and facilitate more sophisticated motion correction methods. In the applications of low dose PET, however, reducing injection dose causes increased noise and reduces signal-to-noise ratio (SNR), subsequently corrupting the motion estimation/correction steps, causing inferior image quality. To tackle these issues, we first propose a Siamese adversarial network (SAN) that can efficiently recover high dose gated image volume from low dose gated image volume. To ensure the appearance consistency between the recovered gate…
Jiangxi Normal University（江西师范大学）；University of Science and Technology of China（中国科学技术大学）；East China Normal University（华东师范大学）；Beijing Jiaotong University（北京交通大学）
Deep-learning-based hyperspectral image (HSI) restoration methods have gained great popularity for their remarkable performance but often demand expensive network retraining whenever the specifics of task changes. In this paper, we propose to restore HSIs in a unified approach with an effective plug-and-play method, which can jointly retain the flexibility of optimization-based methods and utilize the powerful representation capability of deep neural networks. Specifically, we first develop a new deep HSI denoiser leveraging gated recurrent convolution units, short- and long-term skip connecti…
PromptSafe: Gated Prompt Tuning for Safe Text-to-Image Generation
Beihang University（北航）；Beijing University of Posts and Telecommunications（北京邮电大学）；Taishan University（泰山大学）；Nanyang Technological University（南洋理工大学）；Henan University of Science and Technology（河南科技大学）
