arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.08029cs.CV

Class-level Multiple Distributions Representation are Necessary for Semantic Segmentation

Nanjing Normal University(南京师范大学)

Jianjian Yin, Zhichao Zheng, Yanhui Gu, Junsheng Zhou, Yi Chen

英文摘要:

Existing approaches focus on using class-level features to improve semantic segmentation performance. How to characterize the relationships of intra-class pixels and inter-class pixels is the key to extract the discriminative representative class-level features. In this paper, we introduce for the first time to describe intra-class variations by multiple distributions. Then, multiple distributions representation learning(\textbf{MDRL}) is proposed to augment the pixel representations for semantic segmentation. Meanwhile, we design a class multiple distributions consistency strategy to construct discriminative multiple distribution representations of embedded pixels. Moreover, we put forward a multiple distribution semantic aggregation module to aggregate multiple distributions of the corresponding class to enhance pixel semantic information. Our approach can be seamlessly integrated into popular segmentation frameworks FCN/PSPNet/CCNet and achieve 5.61\%/1.75\%/0.75\% mIoU improvements on ADE20K. Extensive experiments on the Cityscapes, ADE20K datasets have proved that our method can bring significant performance improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑