arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.05869cs.CV
收藏

用于异常分割的原型引导网络

Prototype Guided Network for Anomaly Segmentation

Yiqing Hao, Yi Jin, Gaoyun An

摘要:

语义分割方法不能直接识别图像中的异常对象。异常分割算法可以区分分布内对象和分布外(OOD)对象,并输出像素的异常概率。本文提出了一种原型引导的异常分割网络(PGAN),用于从有限的标注图像中提取分布式训练数据的语义原型。在模型中,原型被用来建模的层次类别语义信息和区分OOD像素。提出的PGAN模型包括一个语义分割网络和一个原型抽取网络。采用相似性度量对原型进行优化。将学习到的语义原型作为类别语义,与从测试图像中提取的特征进行相似度比较,然后生成语义分割预测。提出的原型提取网络也可以集成到大多数语义分割网络和识别OOD像素。在StreetHazards数据集上,所提出的PGAN模型产生了53.4%的mIoU用于异常分割。实验结果表明,PGAN在异常分割任务中可以达到SOTA的性能。

英文摘要:

Semantic segmentation methods can not directly identify abnormal objects in images. Anomaly Segmentation algorithm from this realistic setting can distinguish between in-distribution objects and Out-Of-Distribution (OOD) objects and output the anomaly probability for pixels. In this paper, a Prototype Guided Anomaly segmentation Network (PGAN) is proposed to extract semantic prototypes for in-distribution training data from limited annotated images. In the model, prototypes are used to model the hierarchical category semantic information and distinguish OOD pixels. The proposed PGAN model includes a semantic segmentation network and a prototype extraction network. Similarity measures are adopted to optimize the prototypes. The learned semantic prototypes are used as category semantics to compare the similarity with features extracted from test images and then to generate semantic segmentation prediction. The proposed prototype extraction network can also be integrated into most semantic segmentation networks and recognize OOD pixels. On the StreetHazards dataset, the proposed PGAN model produced mIoU of 53.4% for anomaly segmentation. The experimental results demonstrate PGAN may achieve the SOTA performance in the anomaly segmentation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑