arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.00689cs.CL
收藏

CliMedBERT:一个用于气候和健康相关文本的预训练语言模型

CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text

Microsoft AI(微软人工智能)

B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell

摘要:

气候变化正以前所未有的方式威胁着人类健康。除非制定有效的循证政策并采取行动,尽量减少或消除这些威胁,否则这些威胁预计还会增加。要完成这一任务,就需要最大程度地将科学知识转化为政策。多学科、特定地点和广泛的已发表科学使得跟踪这一领域的新工作具有挑战性,也使得传统的知识综合方法在将科学注入政策方面效率低下。为此,我们考虑开发多个特定领域的语言模型(LM),这些模型具有来自气候和健康相关信息的不同变化,可以作为捕获可用知识的基础步骤,以解决不同的任务,例如检测气候和健康相关概念之间的相似性,事实检查,关系抽取,健康影响的证据政策文本生成等。据我们所知,这是第一个工作,提出发展多个特定领域的语言模型所考虑的领域。我们将为研究人员提供开发的模型,资源和代码库。

英文摘要:

Climate change is threatening human health in unprecedented orders and many ways. These threats are expected to grow unless effective and evidence-based policies are developed and acted upon to minimize or eliminate them. Attaining such a task requires the highest degree of the flow of knowledge from science into policy. The multidisciplinary, location-specific, and vastness of published science makes it challenging to keep track of novel work in this area, as well as making the traditional knowledge synthesis methods inefficient in infusing science into policy. To this end, we consider developing multiple domain-specific language models (LMs) with different variations from Climate- and Health-related information, which can serve as a foundational step toward capturing available knowledge to enable solving different tasks, such as detecting similarities between climate- and health-related concepts, fact-checking, relation extraction, evidence of health effects to policy text generation, and more. To our knowledge, this is the first work that proposes developing multiple domain-specific language models for the considered domains. We will make the developed models, resources, and codebase available for the researchers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑