arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.10670cs.CVcs.AI
收藏

通过深度度量学习改进图像联合分割

Improving Image co-segmentation via Deep Metric Learning

Beijing Polytechnic University(北京工业大学)

Zhengwen Li, Xiabi Liu

摘要:

深度度量学习(DML)在计算机视觉任务中很有帮助。本文首先将DML引入图像联合分割中。本文提出了一种新的图像分割的三重损失,简称IS-三重损失,并将其与传统的图像分割损失相结合。与一般的DML任务学习图片间的度量不同,本文将每个像素作为样本,利用其在高维空间中的嵌入特征形成三元组,通过优化IS-Triplet loss,使不同类别的像素之间的距离大于同一类别的像素之间的距离,从而使不同类别的像素在高维特征空间中更容易区分。我们进一步提出了一个有效的三重采样策略,使一个可行的计算IS-三重损失。最后,IS-Triplet损失与3个传统的图像分割损失相结合,进行图像分割。我们将所提出的方法应用于图像联合分割,并在SBCoseg数据集和Internet数据集上进行了测试。实验结果表明,该方法能有效提高高维空间中像素类别的区分度,从而帮助传统的损失法在较少的训练时间内获得更好的图像分割效果。

英文摘要:

Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it with traditional image segmentation loss. Different from the general DML task which learns the metric between pictures, we treat each pixel as a sample, and use their embedded features in high-dimensional space to form triples, then we tend to force the distance between pixels of different categories greater than of the same category by optimizing IS-Triplet loss so that the pixels from different categories are easier to be distinguished in the high-dimensional feature space. We further present an efficient triple sampling strategy to make a feasible computation of IS-Triplet loss. Finally, the IS-Triplet loss is combined with 3 traditional image segmentation losses to perform image segmentation. We apply the proposed approach to image co-segmentation and test it on the SBCoseg dataset and the Internet dataset. The experimental result shows that our approach can effectively improve the discrimination of pixels' categories in high-dimensional space and thus help traditional loss achieve better performance of image segmentation with fewer training epochs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑