arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.08461cs.CV
收藏

用Transformer分割野外透明物体

Segmenting Transparent Object in the Wild with Transformer

The University of Hong Kong(香港大学);Sensetime Research(商汤科技研究院);Nanjing University(南京大学)

Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo

摘要:

本文提出了一种新的细粒度透明对象分割数据集,称为trans 10 k-v2,扩展了第一个大规模透明对象分割数据集trans 10 k-v1。与只有两个有限类别的Trans 10 K-v1不同,我们的新数据集有几个吸引人的好处。(1)它有11个细粒度的透明对象类别,通常出现在人类的家庭环境中,使其更适合现实世界的应用。(2)与以前的版本相比,Trans 10 K-v2为当前的高级分割方法带来了更多的挑战。此外,提出了一种新的基于变换的分割流水线称为trans 2seg。首先,与CNN的局部感受野相比,Trans 2Seg的Transformer编码器提供了全局感受野,这显示出优于纯CNN架构的出色优势。其次,通过将语义分割公式化为字典查找问题,我们设计了一组可学习的原型作为trans 2seg的Transformer解码器的查询,其中每个原型学习整个数据集中的一个类别的统计信息。我们对最近的20多个语义分割方法进行了基准测试,结果表明,Trans 2Seg的性能明显优于所有基于CNN的方法,表明该算法解决透明对象分割的潜在能力。

英文摘要:

This work presents a new fine-grained transparent object segmentation dataset, termed Trans10K-v2, extending Trans10K-v1, the first large-scale transparent object segmentation dataset. Unlike Trans10K-v1 that only has two limited categories, our new dataset has several appealing benefits. (1) It has 11 fine-grained categories of transparent objects, commonly occurring in the human domestic environment, making it more practical for real-world application. (2) Trans10K-v2 brings more challenges for the current advanced segmentation methods than its former version. Furthermore, a novel transformer-based segmentation pipeline termed Trans2Seg is proposed. Firstly, the transformer encoder of Trans2Seg provides the global receptive field in contrast to CNN's local receptive field, which shows excellent advantages over pure CNN architectures. Secondly, by formulating semantic segmentation as a problem of dictionary look-up, we design a set of learnable prototypes as the query of Trans2Seg's transformer decoder, where each prototype learns the statistics of one category in the whole dataset. We benchmark more than 20 recent semantic segmentation methods, demonstrating that Trans2Seg significantly outperforms all the CNN-based methods, showing the proposed algorithm's potential ability to solve transparent object segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑