arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.01599cs.CV
收藏

SCG-Net:用于语义分割的自构造图神经网络

SCG-Net: Self-Constructing Graph Neural Networks for Semantic Segmentation

Norwegian Computing Center(挪威计算中心);UiT the Arctic University of Norway(挪威北极大学)

Qinghui Liu, Michael Kampffmeyer, Robert Jenssen, Arnt-Børre Salberg

摘要:

通过利用长距离像素-像素依赖性来捕获全局上下文表示已被证明可以提高语义分割性能。然而,如何有效地做到这一点是一个悬而未决的问题,因为目前的方法利用注意力计划或非常深的模型来增加模型的视野,导致复杂的模型与大量的内存消耗。受最近图神经网络工作的启发,我们提出了自构造图(SCG)模块,该模块直接从图像中学习远程依赖图,并使用它来有效地传播上下文信息,以改善语义分割。该模块是通过一种新的自适应对角增强方法和变分下界,由一个定制的图形重建项和Kullback-Leibler发散正则化项进行优化。当结合到神经网络(SCG-Net)中时,语义分割以端到端的方式执行,并且与基于相关纯卷积神经网络(CNN)的模型相比,在公开可用的ISPRS波茨坦和Vaihingen数据集上实现了具有竞争力的性能(平均F1分数分别为92.0%和89.8%),参数少得多,计算成本低。

英文摘要:

Capturing global contextual representations by exploiting long-range pixel-pixel dependencies has shown to improve semantic segmentation performance. However, how to do this efficiently is an open question as current approaches of utilising attention schemes or very deep models to increase the models field of view, result in complex models with large memory consumption. Inspired by recent work on graph neural networks, we propose the Self-Constructing Graph (SCG) module that learns a long-range dependency graph directly from the image and uses it to propagate contextual information efficiently to improve semantic segmentation. The module is optimised via a novel adaptive diagonal enhancement method and a variational lower bound that consists of a customized graph reconstruction term and a Kullback-Leibler divergence regularization term. When incorporated into a neural network (SCG-Net), semantic segmentation is performed in an end-to-end manner and competitive performance (mean F1-scores of 92.0% and 89.8% respectively) on the publicly available ISPRS Potsdam and Vaihingen datasets is achieved, with much fewer parameters, and at a lower computational cost compared to related pure convolutional neural network (CNN) based models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑