arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.07464cs.CV
收藏

非模态分割就像做拼图

Amodal segmentation just like doing a jigsaw

Xunli Zeng, Jianqin Yin

摘要:

非模态分割是实例分割的一个新方向,同时考虑了实例中可见和被遮挡部分的分割。现有的方法使用多任务分支分别预测非模态部分和可见部分,并从非模态部分中减去可见部分以获得遮挡部分。然而,非模态部分包含可见信息。因此,分离预测方法将产生重复信息。与此不同,本文提出了一种基于拼图思想的非模态分割方法。该方法利用多任务分支预测可见和遮挡两个自然分离的部分,类似于得到两个匹配的拼图块。然后把两个拼图块在一起得到amodal的一部分。这使得每个分支都专注于对象的建模。并且我们认为现实世界中的遮挡关系是有一定规律的。这是一种遮挡上下文信息。这种拼图方法可以更好地建模遮挡关系,并使用遮挡上下文信息,这是非常重要的非模态分割。在两个广泛使用的非模态标注数据集上的实验证明,我们的方法超过了现有的最先进的方法。这项工作的源代码将很快公开。

英文摘要:

Amodal segmentation is a new direction of instance segmentation while considering the segmentation of the visible and occluded parts of the instance. The existing state-of-the-art method uses multi-task branches to predict the amodal part and the visible part separately and subtract the visible part from the amodal part to obtain the occluded part. However, the amodal part contains visible information. Therefore, the separated prediction method will generate duplicate information. Different from this method, we propose a method of amodal segmentation based on the idea of the jigsaw. The method uses multi-task branches to predict the two naturally decoupled parts of visible and occluded, which is like getting two matching jigsaw pieces. Then put the two jigsaw pieces together to get the amodal part. This makes each branch focus on the modeling of the object. And we believe that there are certain rules in the occlusion relationship in the real world. This is a kind of occlusion context information. This jigsaw method can better model the occlusion relationship and use the occlusion context information, which is important for amodal segmentation. Experiments on two widely used amodally annotated datasets prove that our method exceeds existing state-of-the-art methods. The source code of this work will be made public soon.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑