TextIR: A Simple Framework for Text-based Editable Image Restoration
Tsinghua University(清华大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shanghai AI Laboratory(上海人工智能实验室);Peng Cheng Laboratory(鹏城实验室)
Yunpeng Bai, Cairong Wang, Shuzhao Xie, Chao Dong, Chun Yuan, Zhi Wang
Most existing image restoration methods use neural networks to learn strong image-level priors from huge data to estimate the lost information. However, these works still struggle in cases when images have severe information deficits. Introducing external priors or using reference images to provide information also have limitations in the application domain. In contrast, text input is more readily available and provides information with higher flexibility. In this work, we design an effective framework that allows the user to control the restoration process of degraded images with text descriptions. We use the text-image feature compatibility of the CLIP to alleviate the difficulty of fusing text and image features. Our framework can be used for various image restoration tasks, including image inpainting, image super-resolution, and image colorization. Extensive experiments demonstrate the effectiveness of our method.
From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmark
State Key Laboratory of Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);Department of Computer Science and Engineering, Michigan State University(计算机科学与工程系,密歇根州立大学);School of Computer Science and Technology, Dalian University of Technology(计算机科学与技术学院,大连理工大学)
Jiangxi Normal University(江西师范大学);University of Science and Technology of China(中国科学技术大学);East China Normal University(华东师范大学);Beijing Jiaotong University(北京交通大学)
Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shanghai AI Laboratory(上海人工智能实验室);The Hong Kong Polytechnic University(香港理工大学);ARC Lab, Tencent PCG(腾讯平台与内容事业群ARC实验室);The Chinese University of Hong Kong(香港中文大学)
University at Albany, SUNY(纽约州立大学奥尔巴尼分校);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
Visual-Instructed Degradation Diffusion for All-in-One Image Restoration
State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), CASIA(多模态人工智能系统国家重点实验室(MAIS)、中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Ant Group(蚂蚁集团);PeopleAI Inc.(PeopleAI公司)
Progressive Image Restoration via Text-Conditioned Video Generation
Department of Computer Science, University of Illinois Springfield(伊利诺伊大学斯普林菲尔德分校计算机科学系);School of Electrical and Computer Engineering, Purdue University(普渡大学电气与计算机工程学院)
Nankai International Advanced Research Institute(南开大学国际高等研究院);Peng Cheng Laboratory(鹏城实验室);College of Computer Science, Nankai University(南开大学计算机学院);University of Science and Technology Beijing(北京科技大学);University of Macau(澳门大学)
Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Life Sciences, Tsinghua University(清华大学生命科学学院);Intelligent Science & Technology Academy of CASIC(中国科学院 CASIC 智能科学与技术学院)
How Powerful Potential of Attention on Image Restoration?
Sun Yat-sen University(中山大学);The Hong Kong Polytechnic University(香港理工大学);Nanjing University of Science and Technology(南京理工大学);National University of Singapore(新加坡国立大学);Dalian University of Technology(大连理工大学)
DSwinIR: Rethinking Window-based Attention for Image Restoration
School of Computer Science and Technology, Harbin Institute of Technology(计算机科学与技术学院,哈尔滨工业大学);School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(计算机科学与技术学院,哈尔滨工业大学(深圳))
Attention-Guided Progressive Neural Texture Fusion for High Dynamic Range Image Restoration
Hong Kong Baptist University(香港浸会大学);Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究院);vivo Mobile Communication Co. Ltd(维沃移动通信有限公司);City University of Hong Kong(香港城市大学);Nanyang Technological University(南洋理工大学)
When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration
School of Computer Science and Engineering, Nanjing University of Science and Technology(计算机科学与工程学院,南京理工大学);School of Electrical Engineering, Southeast University(电气工程学院,东南大学);School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院,南京大学)
Dual Prompting Image Restoration with Diffusion Transformers
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学网络科学与技术学院);MoE Key Laboratory of Information Technology(信息科技联合实验室);Huawei Noah’s Ark Lab(华为诺亚实验室);The Chinese University of Hong Kong(香港中文大学);Guangdong Provincial Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室)
PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation
Institute of Data Science, National Cheng Kung University(成功大学数据科学研究所);Graduate Institute of Communication Engineering, National Taiwan University(台湾大学通讯工程学系);NVIDIA(英伟达公司)
CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers
School of Information Science and Technology, University of Science and Technology of China(科学技术大学信息科学与技术学院);ByteDance Intelligent Creation(字节跳动智能创作);School of Computer Science and Technology, Harbin Institute of Technology (Weihai)(哈尔滨工业大学(威海)计算机科学与技术学院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合国家科学中心人工智能研究院)
Editable Noise Map Inversion: Encoding Target-image into Noise For High-Fidelity Image Manipulation
Department of Artificial Intelligence, University of Hanyang, Seoul, Korea(人工智能系,翰阳大学,韩国首尔);Department of Computer Science, University of Hanyang, Seoul, Korea(计算机科学系,翰阳大学,韩国首尔)