arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.05693cs.CVcs.LGeess.IV
收藏

评估剪切粘贴数据增强在卫星图像语义分割中的有效性

Evaluating the Efficacy of Cut-and-Paste Data Augmentation in Semantic Segmentation for Satellite Imagery

Sapienza University of Rome(罗马大学);Department of Computer, Control and Management Engineering(计算机、控制与管理工程系)

Ionut M. Motoi, Leonardo Saraceni, Daniele Nardi, Thomas A. Ciarfuglia

AI总结:

针对卫星图像语义分割中数据稀缺和类别不平衡问题,本文提出一种基于连通组件的剪切粘贴数据增强方法,在DynamicEarthNet数据集上使用U-Net模型将mIoU从37.9提升至44.1,显著增强了模型泛化能力。

摘要:

卫星图像对于环境监测和城市规划等任务至关重要。通常,它依赖于语义分割或土地覆盖(LULC)分类来对每个像素进行分类。尽管深度神经网络(DNNs)带来了进步,但它们在分割任务中的性能受到标记数据可用性有限、类别不平衡以及卫星图像固有的变异性和复杂性等挑战的阻碍。为了缓解这些问题,我们的研究探讨了剪切粘贴增强技术在卫星图像语义分割中的有效性。我们将这种通常需要标记实例的增强方法适应于语义分割的情况。通过利用语义分割标签中的连通组件,我们提取实例,然后在训练期间随机粘贴。使用DynamicEarthNet数据集和U-Net模型进行评估,我们发现这种增强显著提高了测试集上的mIoU分数,从37.9提高到44.1。这一发现凸显了剪切粘贴增强在提高卫星图像语义分割模型泛化能力方面的潜力。

英文摘要:

Satellite imagery is crucial for tasks like environmental monitoring and urban planning. Typically, it relies on semantic segmentation or Land Use Land Cover (LULC) classification to categorize each pixel. Despite the advancements brought about by Deep Neural Networks (DNNs), their performance in segmentation tasks is hindered by challenges such as limited availability of labeled data, class imbalance and the inherent variability and complexity of satellite images. In order to mitigate those issues, our study explores the effectiveness of a Cut-and-Paste augmentation technique for semantic segmentation in satellite images. We adapt this augmentation, which usually requires labeled instances, to the case of semantic segmentation. By leveraging the connected components in the semantic segmentation labels, we extract instances that are then randomly pasted during training. Using the DynamicEarthNet dataset and a U-Net model for evaluation, we found that this augmentation significantly enhances the mIoU score on the test set from 37.9 to 44.1. This finding highlights the potential of the Cut-and-Paste augmentation to improve the generalization capabilities of semantic segmentation models in satellite imagery.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑