In order to improve the quality of synthesized videos, currently, one predominant method involves retraining an expert diffusion model and then implementing a noising-denoising process for refinement. Despite the significant training costs, maintaining consistency of content between the original and enhanced videos remains a major challenge. To tackle this challenge, we propose a novel formulation that considers both visual quality and consistency of content. Consistency of content is ensured by a proposed loss function that maintains the structure of the input, while visual quality is improved by utilizing the denoising process of pretrained diffusion models. To address the formulated optimization problem, we have developed a plug-and-play noise optimization strategy, referred to as Noise Calibration. By refining the initial random noise through a few iterations, the content of original video can be largely preserved, and the enhancement effect demonstrates a notable improvement. Extensive experiments have demonstrated the effectiveness of the proposed method.
Fancy123: One Image to High-Quality 3D Mesh Generation via Plug-and-Play Deformation
Huazhong University of Science and Technology（华中科技大学）；Guangdong Intelligent Robotics Institute（广东智能机器人研究院）；South China University of Technology（华南理工大学）；Pazhou Laboratory（琶洲实验室）
Unified Image Restoration and Enhancement: Degradation Calibrated Cycle Reconstruction Diffusion Model
College of Computer Science and Engineering, Chongqing University of Technology（重庆理工大学计算机科学与工程学院）；School of Science, Engineering and Environment, University of Salford（索尔福德大学科学、工程与环境学院）；College of Computer Science, Chongqing University（重庆大学计算机学院）
Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model
School of Electrical and Information Engineering, Tianjin University（天津大学电气与信息工程学院）；School of Engineering Science, Lappeenranta-Lahti University of Technology LUT（拉彭兰塔-拉赫蒂理工大学工程科学学院）
Nanjing University of Posts and Telecommunications（南京邮电大学）；The Chinese University of Hong Kong（香港中文大学）
The Retinex model is one of the most representative and effective methods for low-light image enhancement. However, the Retinex model does not explicitly tackle the noise problem, and shows unsatisfactory enhancing results. In recent years, due to the excellent performance, deep learning models have been widely used in low-light image enhancement. However, these methods have two limitations: i) The desirable performance can only be achieved by deep learning when a large number of labeled data are available. However, it is not easy to curate massive low/normal-light paired data; ii) Deep learni…
Institute for Parallel and Distributed Systems, University of Stuttgart（斯图加特大学并行与分布式系统研究所）
Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and hence the registration accuracy. Super-resolution (SR) is an algorithmic technique targeting at spatial resolution enhancement which can achieve an image resolution beyond the hardware limitation. In this work, we consider SR as a preprocessing technique and present a CNN-based resolution enhancement module (REM) which can be easily plugged into the registration…
Blur and noise corrupting Computed Tomography (CT) images can hide or distort small but important details, negatively affecting the diagnosis. In this paper, we present a novel gradient-based Plug-and-Play algorithm, constructed on the Half-Quadratic Splitting scheme, and we apply it to restore CT images. In particular, we consider different schemes encompassing external and internal denoisers as priors, defined on the image gradient domain. The internal prior is based on the Total Variation functional. The external denoiser is implemented by a deep Convolutional Neural Network (CNN) trained o…
Predictive Enhancement Calibration for Latent Breast MRI Virtual Contrast Enhancement
The First Affiliated Hospital of Chongqing Medical University（重庆医科大学附属第一医院）；Chongqing Municipal Health Commission（重庆市卫生健康委员会）；Chongqing Translational Medicine Center（重庆市转化医学中心）
Temperature calibration of surface emissivities with an improved thermal image enhancement network
Ningbo Institute of Digital Twin(IDT)（宁波数字孪生研究所）；Zhejiang Shangfeng Special Blower Company Ltd.（浙江尚风专用风机有限公司）；College of Computer Science and Technology, Hangzhou Dianzi University（杭州电子科技大学计算机科学与技术学院）；Hangzhou Dianzi University Shangyu Institute of Science and Engineering Co., Ltd.（杭州电子科技大学尚宇科学与工程有限公司）
EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models
Jilin University（吉林大学）；School of Computer Science, The University of Sydney（悉尼大学计算机科学学院）；ByteDance（字节跳动）；Institute of Translational Medicine, Shanghai Jiao Tong University（上海交通大学转化医学研究院）
P$^2$HCT: Plug-and-Play Hierarchical C2F Transformer for Multi-Scale Feature Fusion
Department of Automation Tsinghua University Beijing, China；Department of R\&D Linsulabs Chengdu, China；School of Information；Communication Engineering University of Electronic Science
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Shenzhen Institute of Artificial Intelligence and Robotics for Society（深圳人工智能与机器人社会研究院）；University of California, Irvine（加利福尼亚大学尔湾分校）
The end-to-end Human Mesh Recovery (HMR) approach has been successfully used for 3D body reconstruction. However, most HMR-based frameworks reconstruct human body by directly learning mesh parameters from images or videos, while lacking explicit guidance of 3D human pose in visual data. As a result, the generated mesh often exhibits incorrect pose for complex activities. To tackle this problem, we propose to exploit 3D pose to calibrate human mesh. Specifically, we develop two novel Pose Calibration frameworks, i.e., Serial PC-HMR and Parallel PC-HMR. By coupling advanced 3D pose estimators an…
AquaFeat+: an Underwater Vision Learning-based Enhancement Method for Object Detection, Classification, and Tracking
Centro de Ciências Computacionais (C3), Universidade Federal do Rio Grande (FURG), Brazil（巴西里约格兰德联邦大学计算科学研究中心（C3））；Instituto de Ciências Exatas e Tecnologia (ICET), Universidade Federal do Amazonas (UFAM), Brazil（巴西亚马逊联邦大学精确科学与技术研究所（ICET））
Semantic segmentation is a classic and fundamental computer vision problem dedicated to assigning each pixel with its corresponding class. Some recent methods introduce edge-based information for improving the segmentation performance. However these methods are specific and limited to certain network architectures, and they can not be transferred to other models or tasks. Therefore, we propose an abstract and universal edge supervision method called Edge-aware Plug-and-play Scheme (EPS), which can be easily and quickly applied to any semantic segmentation models. The core is edge-width/thickne…
University of Rochester（罗切斯特大学）；Arm Research（Arm研究院）；Rochester Institute of Technology（罗切斯特理工学院）
This paper presents a general framework to build fast and accurate algorithms for video enhancement tasks such as super-resolution, deblurring, and denoising. Essential to our framework is the realization that the accuracy, rather than the density, of pixel flows is what is required for high-quality video enhancement. Most of prior works take the opposite approach: they estimate dense (per-pixel)-but generally less robust-flows, mostly using computationally costly algorithms. Instead, we propose a lightweight flow estimation algorithm; it fuses the sparse point cloud data and (even sparser and…
Hefei University of Technology（合肥工业大学）；Zhengzhou University（郑州大学）；Zhejiang University（浙江大学）；Sea AI Lab（Sea人工智能实验室）
Low-light image enhancement (LLIE) aims at improving the illumination and visibility of dark images with lighting noise. To handle the real-world low-light images often with heavy and complex noise, some efforts have been made for joint LLIE and denoising, which however only achieve inferior restoration performance. We attribute it to two challenges: 1) in real-world low-light images, noise is somewhat covered by low-lighting and the left noise after denoising would be inevitably amplified during enhancement; 2) conversion of raw data to sRGB would cause information loss and also more noise, a…
University of Science and Technology of China（中国科学技术大学）；University of Texas at Austin（德克萨斯大学奥斯汀分校）
Low-light images captured in the real world are inevitably corrupted by sensor noise. Such noise is spatially variant and highly dependent on the underlying pixel intensity, deviating from the oversimplified assumptions in conventional denoising. Existing light enhancement methods either overlook the important impact of real-world noise during enhancement, or treat noise removal as a separate pre- or post-processing step. We present \underline{C}oordinated \underline{E}nhancement for \underline{R}eal-world \underline{L}ow-light Noisy Images (CERL), that seamlessly integrates light enhancement …
GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
Shanghai Jiao Tong University（上海交通大学）；State Key Laboratory for General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室，北京通用人工智能研究院）；Beijing Institute of Technology（北京理工大学）
Sagiri: Low Dynamic Range Image Enhancement with Generative Diffusion Prior
Shanghai AI Lab（上海人工智能实验室）；Hefei University of Technology（合肥工业大学）；Snap Inc.（森宝公司）；The Chinese University of Hong Kong（香港中文大学）；Zhejiang University（浙江大学）
