arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.04464cs.CVcs.LG
收藏

PhilEO Bench:评估地理空间基础模型

PhilEO Bench: Evaluating Geo-Spatial Foundation Models

European Space Agency (ESA), ESRIN(欧洲空间局(ESA),ESRIN)

Casper Fibaek, Luke Camilleri, Andreas Luyts, Nikolaos Dionelis, Bertrand Le Saux

AI总结:

本文提出 PhilEO Bench 评估框架及 400 GB Sentinel-2 数据集,用于在建筑物密度估计、道路分割和土地覆盖分类三个下游任务上公平评估 Prithvi、SatMAE 等 EO 基础模型。

摘要:

地球观测(EO)卫星捕获了大量未标记数据,其中 Sentinel-2 星座每天生成 1.6 TB 的数据。这使得遥感成为一个数据丰富的领域,非常适合机器学习(ML)解决方案。然而,将 ML 模型应用于 EO 的一个瓶颈是缺乏标注数据,因为标注是一个劳动密集且成本高昂的过程。因此,该领域的研究一直聚焦于自监督学习和基础模型方法。本文通过引入 PhilEO Bench(一个用于 EO 基础模型的新型评估框架),解决了在不同基础模型之间进行公平且统一基准评估的需求。该框架包含一个测试平台和一个新颖的 400 GB Sentinel-2 数据集,该数据集包含三个下游任务的标签:建筑物密度估计、道路分割和土地覆盖分类。我们展示了使用该框架在不同 n-shot 和收敛速率下评估不同基础模型(包括 Prithvi 和 SatMAE)的实验。

英文摘要:

Massive amounts of unlabelled data are captured by Earth Observation (EO) satellites, with the Sentinel-2 constellation generating 1.6 TB of data daily. This makes Remote Sensing a data-rich domain well suited to Machine Learning (ML) solutions. However, a bottleneck in applying ML models to EO is the lack of annotated data as annotation is a labour-intensive and costly process. As a result, research in this domain has focused on Self-Supervised Learning and Foundation Model approaches. This paper addresses the need to evaluate different Foundation Models on a fair and uniform benchmark by introducing the PhilEO Bench, a novel evaluation framework for EO Foundation Models. The framework comprises of a testbed and a novel 400 GB Sentinel-2 dataset containing labels for three downstream tasks, building density estimation, road segmentation, and land cover classification. We present experiments using our framework evaluating different Foundation Models, including Prithvi and SatMAE, at multiple n-shots and convergence rates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑