arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.04724cs.LGcs.CV
收藏

SustainBench:利用机器学习监测可持续发展目标的基准

SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning

Caltech(加州理工学院);Stanford(斯坦福大学);UC Berkeley(加州大学伯克利分校)

Christopher Yeh, Chenlin Meng, Sherrie Wang, Anne Driscoll, Erik Rozi, Patrick Liu, Jihyeon Lee, Marshall Burke, David B. Lobell, Stefano Ermon

摘要:

联合国可持续发展目标(SDG)的进展一直受到缺乏关键环境和社会经济指标数据的阻碍,这些指标历史上来自时间和空间覆盖范围稀疏的地面调查。机器学习的最新进展使得利用丰富、频繁更新和全球可用的数据(例如来自卫星或社交媒体的数据)成为可能,以提供对可持续发展目标进展的见解。尽管早期的结果很有希望,但到目前为止,使用这些数据进行可持续发展目标测量的方法在很大程度上是在不同的数据集上进行评估,或者使用不一致的评估指标,这使得很难理解性能是否在改善,以及在哪里进行额外的研究将最有成效。此外,处理卫星和地面调查数据需要机器学习社区中许多人缺乏的领域知识。在本文中,我们介绍了SustainBench,这是一个涵盖7个可持续发展目标的15个基准任务的集合,包括与经济发展、农业、健康、教育、水和卫生、气候行动和陆地生命相关的任务。15项任务中有11项的数据集是首次公开发布。我们对SustainBench的目标是(1)降低机器学习社区的准入门槛,以促进衡量和实现可持续发展目标;(2)提供标准基准,用于评估各种可持续发展目标任务上的机器学习模型;(3)鼓励开发新型机器学习方法,其中改进的模型性能有助于实现可持续发展目标。

英文摘要:

Progress toward the United Nations Sustainable Development Goals (SDGs) has been hindered by a lack of data on key environmental and socioeconomic indicators, which historically have come from ground surveys with sparse temporal and spatial coverage. Recent advances in machine learning have made it possible to utilize abundant, frequently-updated, and globally available data, such as from satellites or social media, to provide insights into progress toward SDGs. Despite promising early results, approaches to using such data for SDG measurement thus far have largely evaluated on different datasets or used inconsistent evaluation metrics, making it hard to understand whether performance is improving and where additional research would be most fruitful. Furthermore, processing satellite and ground survey data requires domain knowledge that many in the machine learning community lack. In this paper, we introduce SustainBench, a collection of 15 benchmark tasks across 7 SDGs, including tasks related to economic development, agriculture, health, education, water and sanitation, climate action, and life on land. Datasets for 11 of the 15 tasks are released publicly for the first time. Our goals for SustainBench are to (1) lower the barriers to entry for the machine learning community to contribute to measuring and achieving the SDGs; (2) provide standard benchmarks for evaluating machine learning models on tasks across a variety of SDGs; and (3) encourage the development of novel machine learning methods where improved model performance facilitates progress towards the SDGs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑