arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.06583cs.CV
收藏

恢复交互式分割的具有掩模指导的迭代训练

Reviving Iterative Training with Mask Guidance for Interactive Segmentation

Samsung Electronics Co.(三星电子公司)

Konstantin Sofiiuk, Ilia A. Petrov, Anton Konushin

摘要:

基于点击的交互式分割的最新作品已经通过使用各种推理时间优化方案展示了最先进的结果。与前馈方法相比,这些方法的计算成本要高得多,因为它们需要在推理过程中通过网络执行向后传递,并且很难部署在通常只支持向前传递的移动框架上。在本文中,我们广泛地评估了各种设计选择的交互式分割,并发现,新的国家的最先进的结果,可以获得没有任何额外的优化方案。因此,我们提出了一个简单的基于点击的交互式分割,采用从前面的步骤分割掩模的前馈模型。它不仅允许分割一个全新的对象,而且还可以从外部掩码开始并对其进行校正。当分析在不同数据集上训练的模型的性能时,我们观察到训练数据集的选择极大地影响了交互式分割的质量。我们发现,在COCO和LVIS的组合上训练的模型具有多样化和高质量的注释,表现出优于所有现有模型的性能。代码和训练模型可在https://github.com/saic-vul/ritm_interactive_segmentation上获得。

英文摘要:

Recent works on click-based interactive segmentation have demonstrated state-of-the-art results by using various inference-time optimization schemes. These methods are considerably more computationally expensive compared to feedforward approaches, as they require performing backward passes through a network during inference and are hard to deploy on mobile frameworks that usually support only forward passes. In this paper, we extensively evaluate various design choices for interactive segmentation and discover that new state-of-the-art results can be obtained without any additional optimization schemes. Thus, we propose a simple feedforward model for click-based interactive segmentation that employs the segmentation masks from previous steps. It allows not only to segment an entirely new object, but also to start with an external mask and correct it. When analyzing the performance of models trained on different datasets, we observe that the choice of a training dataset greatly impacts the quality of interactive segmentation. We find that the models trained on a combination of COCO and LVIS with diverse and high-quality annotations show performance superior to all existing models. The code and trained models are available at https://github.com/saic-vul/ritm_interactive_segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑