arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.03084cs.CVcs.AIcs.LG
收藏

基于光电到SAR Few-Shot迁移学习的土地利用预测

Land Use Prediction using Electro-Optical to SAR Few-Shot Transfer Learning

University of Pennsylvania(宾夕法尼亚大学)

Marcel Hussing, Karen Li, Eric Eaton

摘要:

卫星图像分析对土地利用、城市化和生态系统监测具有重要意义。深度学习方法可以通过支持不同卫星模式之间的知识转移来弥补个别缺点,从而促进对电光(EO)和合成孔径雷达(SAR)图像等不同卫星模式的分析。最近的进展表明,神经网络嵌入的分布对齐如何通过采用切片Wasserstein距离(SWD)损失来产生强大的迁移学习模型。我们分析了如何将这种方法应用于哨兵-1和-2卫星图像,并开发了几个扩展,使其在实践中有效。在Few-Shot Local Climate Zone(LCZ)预测的应用中,我们证明了这些网络在具有大量类的数据集上优于多个常见基线。此外,我们提供的证据表明,实例规范化可以显着稳定的训练过程,并明确塑造嵌入空间使用监督对比学习可以提高性能。

英文摘要:

Satellite image analysis has important implications for land use, urbanization, and ecosystem monitoring. Deep learning methods can facilitate the analysis of different satellite modalities, such as electro-optical (EO) and synthetic aperture radar (SAR) imagery, by supporting knowledge transfer between the modalities to compensate for individual shortcomings. Recent progress has shown how distributional alignment of neural network embeddings can produce powerful transfer learning models by employing a sliced Wasserstein distance (SWD) loss. We analyze how this method can be applied to Sentinel-1 and -2 satellite imagery and develop several extensions toward making it effective in practice. In an application to few-shot Local Climate Zone (LCZ) prediction, we show that these networks outperform multiple common baselines on datasets with a large number of classes. Further, we provide evidence that instance normalization can significantly stabilize the training process and that explicitly shaping the embedding space using supervised contrastive learning can lead to improved performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑