arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.01887cs.LG
收藏

从科学文献中分析气候变化对关键基础设施的影响:弱监督NLP方法

Analyzing the impact of climate change on critical infrastructure from the scientific literature: A weakly supervised NLP approach

Argonne National Laboratory(阿贡国家实验室)

Tanwi Mallick, Joshua David Bergerson, Duane R. Verner, John K Hutchison, Leslie-Anne Levy, Prasanna Balaprakash

摘要:

自然语言处理(NLP)是分析大量气候变化和基础设施相关科学文献的一种有前途的方法。然而,最佳实践的NLP技术需要大量的相关文档(语料库)。此外,使用机器学习和深度学习技术的NLP技术需要基于语料库的重要子集的用户定义的标准对文章进行标签分组,以便训练监督模型。即使是用人类主题专家标记几百个文档也是一个耗时的过程。为了加快这一过程,我们开发了一种基于弱监督的NLP方法,该方法利用类别和文档之间的语义相似性来(i)通过对大规模开放访问语料库进行子集化来建立特定主题的语料库,以及(ii)为特定主题的语料库生成类别标签。与主题专家标注长达一个月的过程相比,我们使用弱监督和监督学习在大约13个小时内为整个语料库分配类别标签。标记的气候和NCF语料库能够有针对性地有效识别讨论感兴趣的主题(或主题组合)的文件,并识别气候变化对关键基础设施的各种影响,提高科学文献的可用性,并最终支持增强的政策和决策。为了证明这种能力,我们对气候灾害和NCF进行主题建模,以发现这些类别交叉点的趋势主题。这种方法有助于分析人员和决策者快速掌握相关主题以及与主题相关的最重要的文档。

英文摘要:

Natural language processing (NLP) is a promising approach for analyzing large volumes of climate-change and infrastructure-related scientific literature. However, best-in-practice NLP techniques require large collections of relevant documents (corpus). Furthermore, NLP techniques using machine learning and deep learning techniques require labels grouping the articles based on user-defined criteria for a significant subset of a corpus in order to train the supervised model. Even labeling a few hundred documents with human subject-matter experts is a time-consuming process. To expedite this process, we developed a weak supervision-based NLP approach that leverages semantic similarity between categories and documents to (i) establish a topic-specific corpus by subsetting a large-scale open-access corpus and (ii) generate category labels for the topic-specific corpus. In comparison with a months-long process of subject-matter expert labeling, we assign category labels to the whole corpus using weak supervision and supervised learning in about 13 hours. The labeled climate and NCF corpus enable targeted, efficient identification of documents discussing a topic (or combination of topics) of interest and identification of various effects of climate change on critical infrastructure, improving the usability of scientific literature and ultimately supporting enhanced policy and decision making. To demonstrate this capability, we conduct topic modeling on pairs of climate hazards and NCFs to discover trending topics at the intersection of these categories. This method is useful for analysts and decision-makers to quickly grasp the relevant topics and most important documents linked to the topic.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑