arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.12095cs.CVcs.DB
收藏

Major TOM:面向地球观测的可扩展数据集

Major TOM: Expandable Datasets for Earth Observation

European Space Agency(欧洲空间局)

Alistair Francis, Mikolaj Czerkawski

AI总结:

针对地球观测领域数据集分散、互操作性差的问题,提出可扩展框架Major TOM,含地理索引与元数据结构,同时发布覆盖绝大多数陆地的开放数据集MajorTOM-Core,提供可用资源并为生态扩展打样。

摘要:

深度学习模型对数据的需求日益增长,需要投入大量资源来收集和整理训练所需的数据集,地球观测(EO)模型也不例外。然而,EO领域的数据集相对分散,格式和数据结构的多样性导致互操作性较差。若要构建规模更大的数据集并尽量减少重复工作,就需要一个能让用户组合和访问多个数据集的共享框架。本文提出了Major TOM(Terrestrial Observation Metaset,陆地观测元数据集)作为这一可扩展框架。它主要由基于一组网格点的地理索引系统和元数据结构组成,支持合并来自不同来源的多个数据集。除了提出Major TOM框架的规范外,本研究还发布了一个大型开放获取数据集MajorTOM-Core,其覆盖了地球绝大多数陆地表面。该数据集既能为学界提供立即可用的资源,也可作为未来Major TOM生态系统新增内容的模板。访问地址:https://huggingface.co/Major-TOM

英文摘要:

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is relatively atomised, with interoperability made difficult by diverse formats and data structures. If ever larger datasets are to be built, and duplication of effort minimised, then a shared framework that allows users to combine and access multiple datasets is needed. Here, Major TOM (Terrestrial Observation Metaset) is proposed as this extensible framework. Primarily, it consists of a geographical indexing system based on a set of grid points and a metadata structure that allows multiple datasets with different sources to be merged. Besides the specification of Major TOM as a framework, this work also presents a large, open-access dataset, MajorTOM-Core, which covers the vast majority of the Earth's land surface. This dataset provides the community with both an immediately useful resource, as well as acting as a template for future additions to the Major TOM ecosystem. Access: https://huggingface.co/Major-TOM

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑