arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.00570cs.LGphysics.geo-ph
收藏

地球监测基础模型:气候变化基准建议

Toward Foundation Models for Earth Monitoring: Proposal for a Climate Change Benchmark

Element AI;Service Now(ServiceNow);Stanford University(斯坦福大学);University of Maryland(马里兰大学);Radiant Earth Foundation;MIT(麻省理工学院);ETH Zurich(苏黎世联邦理工学院)
Alexandre Lacoste, Evan David Sherwin, Hannah Kerner, Hamed Alemohammad, Björn Lütjens, Jeremy Irvin, David Dao, Alex Chang, Mehmet Gunturkun, Alexandre Drouin,… 展开作者

Alexandre Lacoste, Evan David Sherwin, Hannah Kerner, Hamed Alemohammad, Björn Lütjens, Jeremy Irvin, David Dao, Alex Chang, Mehmet Gunturkun, Alexandre Drouin, Pau Rodriguez, David Vazquez

摘要:

自我监督的最新进展表明,在大量无监督数据上预训练大型神经网络可以导致下游任务的泛化能力显著提高。这种模型,最近被创造为基础模型,已经转变到自然语言处理领域。虽然类似的模型也在大型图像语料库上进行了训练,但它们并不适合遥感数据。为了促进地球监测基础模型的发展,我们建议制定一个新的基准,包括与气候变化有关的各种下游任务。我们相信,这可以大大改善许多现有的应用程序,并促进新的应用程序的开发。该提案还呼吁开展合作,以制定更好的评价程序,减轻地球监测基础模型的潜在不利因素。

英文摘要:

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation models, have been transformational to the field of natural language processing. While similar models have also been trained on large corpuses of images, they are not well suited for remote sensing data. To stimulate the development of foundation models for Earth monitoring, we propose to develop a new benchmark comprised of a variety of downstream tasks related to climate change. We believe that this can lead to substantial improvements in many existing applications and facilitate the development of new applications. This proposal is also a call for collaboration with the aim of developing a better evaluation process to mitigate potential downsides of foundation models for Earth monitoring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑