arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.09104cs.CV
收藏

语义边缘检测的动态特征融合

Dynamic Feature Fusion for Semantic Edge Detection

Institute of Remote Sensing and Digital Earth, CAS(中国科学院遥感与数字地球研究所);University of Chinese Academy of Sciences(中国科学院大学);National University of Singapore(新加坡国立大学)

Yuan Hu, Yunpeng Chen, Xiang Li, Jiashi Feng

摘要:

如果多尺度特征融合良好,则它们可以极大地有利于语义边缘检测任务。然而,流行的语义边缘检测方法应用固定权重融合策略,其中具有不同语义的图像被强制共享相同的权重,从而导致所有图像和位置的通用融合权重,而不管它们的不同语义或局部上下文。在这项工作中,我们提出了一种新的动态特征融合策略,自适应地为不同的输入图像和位置分配不同的融合权重。这是通过一个建议的权重学习器来实现的,该权重学习器以特定输入为条件,针对特征图的每个位置在多层次特征上推断适当的融合权重。通过这种方式,可以更好地考虑由特征图和输入图像的不同位置做出的贡献的异质性,从而有助于产生更准确和更清晰的边缘预测。通过对基准Cityscapes和SBD的综合实验,我们证明了我们的模型与新的动态特征融合优于固定权重融合和朴素的位置不变权重融合方法。特别是,我们的方法优于所有现有的完善的方法,并实现了新的国家的最先进的。

英文摘要:

Features from multiple scales can greatly benefit the semantic edge detection task if they are well fused. However, the prevalent semantic edge detection methods apply a fixed weight fusion strategy where images with different semantics are forced to share the same weights, resulting in universal fusion weights for all images and locations regardless of their different semantics or local context. In this work, we propose a novel dynamic feature fusion strategy that assigns different fusion weights for different input images and locations adaptively. This is achieved by a proposed weight learner to infer proper fusion weights over multi-level features for each location of the feature map, conditioned on the specific input. In this way, the heterogeneity in contributions made by different locations of feature maps and input images can be better considered and thus help produce more accurate and sharper edge predictions. We show that our model with the novel dynamic feature fusion is superior to fixed weight fusion and also the naïve location-invariant weight fusion methods, via comprehensive experiments on benchmarks Cityscapes and SBD. In particular, our method outperforms all existing well established methods and achieves new state-of-the-art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑