Under Display相机为手机制造商提供了一个充满希望的机会,通过将相机定位在半透明OLED屏幕后面来实现无边框显示。不幸的是,这种成像系统由于光衰减和衍射效应而遭受严重的图像退化。在这项工作中,我们提出了深度Atrous引导滤波器(DAGF),一个两阶段,端到端的方法,图像复原在UDC系统。低分辨率网络首先以低分辨率恢复图像质量,随后被引导滤波器网络用作滤波输入以产生高分辨率输出。除了初始下采样,我们的低分辨率网络还使用多个并行的无环卷积来保持空间分辨率,并模拟多尺度处理。我们的方法的能力,直接训练的百万像素图像的结果在显着的性能提高。我们还提出了一个简单的模拟方案来预训练我们的模型并提高性能。我们的整体框架在RLQ-TOD'20 UDC挑战赛中分别在POLED和TOLED显示屏领域排名第二和第五。
英文摘要:
Under Display Cameras present a promising opportunity for phone manufacturers to achieve bezel-free displays by positioning the camera behind semi-transparent OLED screens. Unfortunately, such imaging systems suffer from severe image degradation due to light attenuation and diffraction effects. In this work, we present Deep Atrous Guided Filter (DAGF), a two-stage, end-to-end approach for image restoration in UDC systems. A Low-Resolution Network first restores image quality at low-resolution, which is subsequently used by the Guided Filter Network as a filtering input to produce a high-resolution output. Besides the initial downsampling, our low-resolution network uses multiple, parallel atrous convolutions to preserve spatial resolution and emulates multi-scale processing. Our approach's ability to directly train on megapixel images results in significant performance improvement. We additionally propose a simple simulation scheme to pre-train our model and boost performance. Our overall framework ranks 2nd and 5th in the RLQ-TOD'20 UDC Challenge for POLED and TOLED displays, respectively.
UDC-UNet: Under-Display Camera Image Restoration via U-Shape Dynamic Network
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);University of Macau(澳门大学);Shanghai AI Laboratory(上海人工智能实验室)
Segmentation Guided Sparse Transformer for Under-Display Camera Image Restoration
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Hong Kong University of Science and Technology(香港科技大学);State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);Samsung Research China - Beijing (SRC-B)(三星中国研究院北京分部);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳校区);SAMSUNG Electronics(三星电子)
State Key Lab for Novel Software Technology, Nanjing University(南京大学现代软件技术国家重点实验室);Australian National University(澳大利亚国立大学);Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Samsung Research China-Beijing (SRC-B)(三星中国研究院北京分部);Imperial College London(伦敦帝国学院)
Combined Flicker-banding and Moire Removal for Screen-Captured Images
Shanghai Jiao Tong University, Shanghai, China(上海交通大学);Central Media Technology Institute, Huawei, China(华为中央媒体技术研究所);Department of XXX, University of YYY, Location, Country(YYY大学XXX系);School of ZZZ, Institute of WWW, Location, Country(ZZZ学院WWW研究所)
From Fog Chamber to Aircraft Window: Pixel-Registered Imaging and Synthetic Fine-Tuning Enable Cross-Domain Defogging
Department of Electrical and Computer Engineering, University of Utah(犹他大学电气与计算机工程系);U.S. Naval Research Laboratory Remote Sensing Division(美国海军研究实验室远程传感部门)
MvKSR: Multi-view Knowledge-guided Scene Recovery for Hazy and Rainy Degradation
The Hong Kong Polytechnic University(香港理工大学);Wuhan University of Technology(武汉理工大学);Wuhan Baosight Software Co., Ltd(武汉宝信软件有限公司);Singapore Management University(新加坡管理大学)
UDC-VIT: A Real-World Video Dataset for Under-Display Cameras
Dept. of Data Science, Seoul National University(数据科学系,首尔国立大学);Dept. of Computer Science and Engineering, Seoul National University(计算机科学与工程系,首尔国立大学);Research Center, Samsung Display Co., Ltd.(三星显示公司研究部);Mobile Display Electronics Development Team, Samsung Display Co., Ltd.(三星显示公司移动显示电子开发团队)
Deconvolution of vibroacoustic images using a simulation model based on a three dimensional point spread function
Instituto de Matemática e Estatística, Universidade de São Paulo(圣保罗大学数学与统计研究所);Universidade Federal de São Carlos(圣卡洛斯联邦大学);Mayo Clinic College of Medicine(梅奥诊所医学院);Universidade Federal de Alagoas(阿拉戈斯联邦大学)
MoiréNet: A Compact Dual-Domain Network for Image Demoiréing
School of Future Science and Engineering, Soochow University, China(未来科学与工程学院,苏州大学);Clobotics, China(中国Clobotics公司);Fraunhofer Institute for Applied Information Technology, Germany(德国应用信息技术研究所);School of Mathematical and Computer Sciences, Heriot-Watt University (Malaysia Campus), Malaysia(数学与计算机科学学院,赫瑞-瓦特大学(马来西亚校区))
Learning Weighting Map for Bit-Depth Expansion within a Rational Range
School of Software, Dalian University of Technology(大连理工大学软件学院);International School of Information Science and Engineering, Dalian University of Technology(大连理工大学国际信息与工程学院);School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School(北京大学深圳研究生院电子与计算机工程学院)