arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.05835cs.CVeess.IV
收藏

用于基于深度学习的高效图像复原的轻量级模块

Lightweight Modules for Efficient Deep Learning based Image Restoration

Indian Institute of Technology Kharagpur(印度理工学院克勒格布尔分校);Mathworks(Mathworks公司)

Avisek Lahiri, Sourav Bairagya, Sutanu Bera, Siddhant Haldar, Prabir Kumar Biswas

摘要:

低水平图像复原是现代人工智能(AI)驱动的相机流水线的组成部分。这些框架中的大多数基于深度神经网络,其在资源受限的平台(如移动电话)上呈现出巨大的计算开销。在本文中,我们提出了几个轻量级的低级别模块,可用于创建一个给定的基线模型的计算成本低的变体。最近的工作,有效的神经网络设计主要集中在分类。然而,低级图像处理属于图像到图像的翻译类型,它需要一些分类中不存在的额外计算模块。本文试图通过设计通用高效模块来弥合这一差距,这些模块可以取代当代基于深度学习的图像复原网络中使用的基本组件。我们还提出并分析了我们的结果,强调了将深度可分离卷积核(一种用于高效分类网络的流行方法)应用于基于亚像素卷积的上采样(一种用于低级视觉应用的流行上采样策略)的缺点。这表明,分类领域的概念并不总是能够无缝地集成到图像到图像的翻译任务中。我们广泛验证了我们的研究结果的三个流行的任务图像修补,去噪和超分辨率。我们的研究结果表明,与全容量基线相比,建议的网络始终输出视觉上相似的重建,并在当代移动设备上显着减少参数,内存占用和执行速度。

英文摘要:

Low level image restoration is an integral component of modern artificial intelligence (AI) driven camera pipelines. Most of these frameworks are based on deep neural networks which present a massive computational overhead on resource constrained platform like a mobile phone. In this paper, we propose several lightweight low-level modules which can be used to create a computationally low cost variant of a given baseline model. Recent works for efficient neural networks design have mainly focused on classification. However, low-level image processing falls under the image-to-image' translation genre which requires some additional computational modules not present in classification. This paper seeks to bridge this gap by designing generic efficient modules which can replace essential components used in contemporary deep learning based image restoration networks. We also present and analyse our results highlighting the drawbacks of applying depthwise separable convolutional kernel (a popular method for efficient classification network) for sub-pixel convolution based upsampling (a popular upsampling strategy for low-level vision applications). This shows that concepts from domain of classification cannot always be seamlessly integrated into image-to-image translation tasks. We extensively validate our findings on three popular tasks of image inpainting, denoising and super-resolution. Our results show that proposed networks consistently output visually similar reconstructions compared to full capacity baselines with significant reduction of parameters, memory footprint and execution speeds on contemporary mobile devices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑