arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.19271cs.CVeess.IV
收藏

下水道图像超分辨率与深度先验及其轻量化网络

Sewer Image Super-Resolution with Depth Priors and Its Lightweight Network

Tianjin University(天津大学);Hefei University of Technology(合肥工业大学);Tianjin Municipal Engineering Design and Research Institute(天津市市政工程设计研究院);PipeChina(中国管输);Tianjin University of Science and Technology(天津科技大学);University of California, Irvine(加州大学欧文分校)

Gang Pan, Chen Wang, Zhijie Sui, Shuai Guo, Yaozhi Lv, Honglie Li, Di Sun, Zixia Xia

AI总结:

针对下水道QV图像远距离部分质量差的问题,提出深度引导的参考超分辨率框架DSRNet,利用深度先验和注意力蒸馏轻量化模型,显著提升PSNR/SSIM及下游任务性能。

摘要:

Quick-view(QV)技术是检测排水系统缺陷的主要方法。然而,QV的有效性受到其硬件有限视觉范围的阻碍,导致排水管网远距离部分的图像质量欠佳。图像超分辨率是改善图像质量的有效途径,并已应用于多种场景。然而,针对下水道图像的超分辨率研究仍相当未开发。为此,本研究利用QV图像中固有的深度关系,提出了一种新颖的深度引导的基于参考的超分辨率框架,记为DSRNet。它包含两个核心组件:深度提取模块和深度信息匹配模块(DMM)。DSRNet利用低分辨率图像的相邻帧作为参考图像,并基于相关性帮助它们恢复纹理信息。通过结合这些模块,深度先验的集成显著提升了视觉质量和性能基准。此外,为了追求计算效率和紧凑性,引入了一种基于注意力机制的超分辨率知识蒸馏模型。该机制促进了更复杂的教师模型与精简学生模型之间的特征相似性获取,后者是DSRNet的轻量化版本。实验结果表明,与其他方法相比,DSRNet显著提高了PSNR和SSIM。本研究还在Pipe数据集和Sewer-ML数据集上进行了下水道缺陷语义分割、目标检测和分类实验。实验表明,该方法能够提高低分辨率下水道图像在这些任务中的性能。

英文摘要:

The Quick-view (QV) technique serves as a primary method for detecting defects within sewerage systems. However, the effectiveness of QV is impeded by the limited visual range of its hardware, resulting in suboptimal image quality for distant portions of the sewer network. Image super-resolution is an effective way to improve image quality and has been applied in a variety of scenes. However, research on super-resolution for sewer images remains considerably unexplored. In response, this study leverages the inherent depth relationships present within QV images and introduces a novel Depth-guided, Reference-based Super-Resolution framework denoted as DSRNet. It comprises two core components: a depth extraction module and a depth information matching module (DMM). DSRNet utilizes the adjacent frames of the low-resolution image as reference images and helps them recover texture information based on the correlation. By combining these modules, the integration of depth priors significantly enhances both visual quality and performance benchmarks. Besides, in pursuit of computational efficiency and compactness, a super-resolution knowledge distillation model based on an attention mechanism is introduced. This mechanism facilitates the acquisition of feature similarity between a more complex teacher model and a streamlined student model, with the latter being a lightweight version of DSRNet. Experimental results demonstrate that DSRNet significantly improves PSNR and SSIM compared with other methods. This study also conducts experiments on sewer defect semantic segmentation, object detection, and classification on the Pipe dataset and Sewer-ML dataset. Experiments show that the method can improve the performance of low-resolution sewer images in these tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑