This paper proposes a general framework for internal patch-based image restoration based on Conditional Random Fields (CRF). Unlike related models based on Markov Random Fields (MRF), our approach explicitly formulates the posterior distribution for the entire image. The potential functions are taken as proportional to the product of a likelihood and prior for each patch. By assuming identical parameters for similar patches, our approach can be classified as a model-based non-local method. For the prior term in the potential function of the CRF model, multivariate Gaussians and multivariate scale-mixture of Gaussians are considered, with the latter being a novel prior for image patches. Our results show that the proposed approach outperforms methods based on Gaussian mixture models for image denoising and state-of-the-art methods for image interpolation/inpainting.
EnsIR: An Ensemble Algorithm for Image Restoration via Gaussian Mixture Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间安全学院);Samsung Research China - Beijing (SRC-B)(三星中国研究院北京分院);Camera Innovation Group, Samsung Electronics(三星电子相机创新集团)
M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts
School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Computer Science and Technology, Anhui University of Technology(安徽工业大学计算机科学与技术学院);Shenzhen Ubiquitous Data Enabling Key Laboratory, Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院深圳 ubiquitous 数据赋能重点实验室);College of Artificial Intelligence, Taiyuan University of Technology(太原科技大学人工智能学院)
LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video Restoration
Shandong Normal University(山东师范大学);China Academy of Information and Communications Technology(中国信息通信研究院);Central South University(中南大学);Nanjing University of Science and Technology(南京理工大学);Hebei University of Technology(河北工业大学);Shandong University of Finance and Economics(山东财经大学);National University of Defense Technology(国防科技大学)
M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restoration
School of Computer Science and Technology, Anhui University of Technology(安徽理工大学计算机科学与技术学院);School of Cyberspace Security, Sun Yat-sen University(中山大学网络安全学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);College of Artificial Intelligence, Taiyuan University of Technology(太原科技大学人工智能学院)
Pathology Image Restoration via Mixture of Prompts
ShanghaiTech University(上海科技大学);Shanghai Jiao Tong University(上海交通大学);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心);Nanjing University of Information Science and Technology(南京信息工程大学)
Compositional-Degradation UAV Image Restoration: Conditional Decoupled MoE Network and A Benchmark
Key Laboratory of Intelligent Computing & Signal Processing (Anhui University), Ministry of Education(教育部智能计算与信号处理重点实验室(安徽大学));Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院)
Simpler and Stronger Baselines for All-in-One Image Restoration
School of Mathematics, Tianjin University(天津大学数学学院);School of Cybersecurity, Tianjin University(天津大学网络安全学院);School of Artificial Intelligence, Tianjin University(天津大学人工智能学院)
Dual Prompting Image Restoration with Diffusion Transformers
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学网络科学与技术学院);MoE Key Laboratory of Information Technology(信息科技联合实验室);Huawei Noah’s Ark Lab(华为诺亚实验室);The Chinese University of Hong Kong(香港中文大学);Guangdong Provincial Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室)
A Unified Foundation Model for All-in-One Multi-Modal Remote Sensing Image Restoration and Fusion with Language Prompting
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
Accelerating GMM-based patch priors for image restoration: Three ingredients for a 100$\times$ speed-up
University of California, San Diego(加州大学圣迭戈分校);IMB, CNRS, Univ. Bordeaux, Bordeaux INP(波尔多大学,法国国家科学研究中心,波尔多综合理工学院);Univ Lyon, UJM-Saint-Etienne, CNRS, Institut d Optique Graduate School, Laboratoire Hubert Curien UMR 5516(里昂大学,圣埃蒂安让·莫奈大学,法国国家科学研究中心,光学研究生院,于贝尔·居里安实验室)
AdaQual-Diff: Diffusion-Based Image Restoration via Adaptive Quality Prompting
Fuzhou University(福州大学);University of Science and Technology of China(中国科学技术大学);University of the Chinese Academy of Sciences(中国科学院大学);Shandong Normal University(山东师范大学);Sun Yat-sen University(中山大学)
Image denoising with generalized Gaussian mixture model patch priors
Institut de Mathématiques de Bordeaux, CNRS, Université de Bordeaux, Bordeaux INP(波尔多数学研究所、法国国家科学研究中心、波尔多大学、波尔多国立理工学院);University of California, San Diego(加利福尼亚大学圣地亚哥分校)