arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.07616cs.CV
收藏

卫星图像时间序列语义变化检测:新型架构与域偏移分析

Satellite Image Time Series Semantic Change Detection: Novel Architecture and Analysis of Domain Shift

LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, France(法国国立桥梁学校 Gustave Eiffel大学 CNRS LIGM实验室);Inria Paris(法国国家信息与自动化研究所巴黎中心);Department of Computer Science, Ecole normale supérieure (ENS-PSL, CNRS, Inria)(巴黎文理研究大学 巴黎高等师范学院 计算机科学系);Courant Institute of Mathematical Sciences and Center for Data Science, New York University(纽约大学柯朗数学科学研究所与数据科学中心)

Elliot Vincent, Jean Ponce, Mathieu Aubry

AI总结:

该研究针对卫星图像时间序列语义变化检测任务提出新型架构,同时探究时空偏移对模型的影响,发现空间域偏移最复杂,时间偏移对变化检测的影响更显著。

摘要:

卫星图像在监测地球表面变化、助力气候分析、生态系统评估和灾害响应方面发挥着关键作用。本文针对卫星图像时间序列语义变化检测(SITS-SCD)任务展开研究,该任务涵盖变化检测与语义分割两项子任务。我们提出了一种新型架构,其性能优于现有最优水平,随参数量增长的扩展性更佳,且能利用长期时序信息。但在实际应用场景中,模型需要适配空间和时间偏移,这仍是一项挑战。我们使用DynamicEarthNet和MUDS这两个全球多年度SITS数据集,分别探究了时间偏移与空间偏移的影响。研究表明,空间域偏移是最复杂的场景,且时间偏移对变化检测性能的影响比对语义分割的影响更显著,凸显出这是一个值得进一步关注的特定问题。

英文摘要:

Satellite imagery plays a crucial role in monitoring changes happening on Earth's surface and aiding in climate analysis, ecosystem assessment, and disaster response. In this paper, we tackle semantic change detection with satellite image time series (SITS-SCD) which encompasses both change detection and semantic segmentation tasks. We propose a new architecture that improves over the state of the art, scales better with the number of parameters, and leverages long-term temporal information. However, for practical use cases, models need to adapt to spatial and temporal shifts, which remains a challenge. We investigate the impact of temporal and spatial shifts separately on global, multi-year SITS datasets using DynamicEarthNet and MUDS. We show that the spatial domain shift represents the most complex setting and that the impact of temporal shift on performance is more pronounced on change detection than on semantic segmentation, highlighting that it is a specific issue deserving further attention.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑