标准化最大Logits:一种简单有效的城市场景分割中意外道路障碍物识别方法
Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentation
摘要:
在语义分割中识别道路上的意外对象(例如,识别道路上的狗)在安全关键应用中至关重要。现有的方法使用来自外部数据集的意外对象的图像或需要额外的训练(例如,重新训练分段网络或训练额外的网络),这需要大量的劳动强度或冗长的推理时间。一种可能的替代方案是使用预先训练的网络的预测分数,例如最大logits(即,最后softmax层之前的类之间的最大值)来检测这样的对象。然而,每个预测类的最大logits的分布是显着不同的,这降低了识别城市场景分割中的意外对象的性能。为了解决这个问题,我们提出了一种简单而有效的方法,它可以调整最大logits,以便对齐不同的分布,并反映每个预测类中最大logits的相对含义。此外,我们认为从两个不同的角度来看,基于直觉,相邻像素共享相似的语义信息的局部区域。与以前的方法相比,我们的方法不使用任何外部数据集或需要额外的训练,这使得我们的方法广泛适用于现有的预训练分割模型。这种直接的方法在公开的Fishyscapes Lost & Found排行榜上实现了新的最先进的表现。我们的代码可在此$\href{https://github.com/shjung13/Standardized-max-logits}{link}$上公开获取。
英文摘要:
Identifying unexpected objects on roads in semantic segmentation (e.g., identifying dogs on roads) is crucial in safety-critical applications. Existing approaches use images of unexpected objects from external datasets or require additional training (e.g., retraining segmentation networks or training an extra network), which necessitate a non-trivial amount of labor intensity or lengthy inference time. One possible alternative is to use prediction scores of a pre-trained network such as the max logits (i.e., maximum values among classes before the final softmax layer) for detecting such objects. However, the distribution of max logits of each predicted class is significantly different from each other, which degrades the performance of identifying unexpected objects in urban-scene segmentation. To address this issue, we propose a simple yet effective approach that standardizes the max logits in order to align the different distributions and reflect the relative meanings of max logits within each predicted class. Moreover, we consider the local regions from two different perspectives based on the intuition that neighboring pixels share similar semantic information. In contrast to previous approaches, our method does not utilize any external datasets or require additional training, which makes our method widely applicable to existing pre-trained segmentation models. Such a straightforward approach achieves a new state-of-the-art performance on the publicly available Fishyscapes Lost & Found leaderboard with a large margin. Our code is publicly available at this $\href{https://github.com/shjung13/Standardized-max-logits}{link}$.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。