arXiv 2306.102412023-06-17cs.CLcs.AI

Snowman：从基础模型中提炼的百万级中文常识知识图谱

Snowman: A Million-scale Chinese Commonsense Knowledge Graph Distilled from Foundation Model

Soochow University（苏州大学）；Beijing Jiaotong University（北京交通大学）；Fudan University（复旦大学）；Macquarie University（麦考瑞大学）；iFLYTEK Research（科大讯飞研究院）

Jiaan Wang, Jianfeng Qu, Yunlong Liang, Zhixu Li, An Liu, Guanfeng Liu, Xin Zheng

备注：: tech report

阅读 PDF

arXiv 页面 ↗HTML 原文 ↗

AI总结：

本文利用ChatGPT等基础模型构建了名为Snowman的中文常识知识图谱，通过自我指导过滤策略去除无效负向常识，最终包含超千万条三元组，人工接受度达90.6%，成为最大的中文常识知识图谱。

摘要：

构建常识知识图谱（CKGs）因其在认知智能中的重要意义而引起了广泛的研究关注。然而，现有的常识知识图谱通常面向英语，限制了非英语语言的研究。与此同时，ChatGPT和GPT-4等基础模型的出现，借助从人类反馈中进行强化学习，展现出了有前景的智能水平。在此背景下，本文利用基础模型构建了一个名为Snowman的中文常识知识图谱。具体来说，我们从ChatGPT中提炼出不同类型的常识头实体，并继续使用它来收集与头实体和预定义关系相对应的尾实体。基于初步分析，我们发现由ChatGPT提炼的负向常识知识在人类接受度上低于其他知识。因此，我们设计了一种简单而有效的自我指导过滤策略，以过滤掉无效的负向常识。总体而言，构建的Snowman涵盖了超过一千万条中文常识三元组，使其成为最大的中文常识知识图谱。此外，人工研究表明，Snowman的接受度达到了90.6%，表明由尖端基础模型提炼的三元组具有高质量。我们还对常识知识模型进行了实验，以展示Snowman的可用性和有效性。

英文摘要：

Constructing commonsense knowledge graphs (CKGs) has attracted wide research attention due to its significant importance in cognitive intelligence. Nevertheless, existing CKGs are typically oriented to English, limiting the research in non-English languages. Meanwhile, the emergence of foundation models like ChatGPT and GPT-4 has shown promising intelligence with the help of reinforcement learning from human feedback. Under the background, in this paper, we utilize foundation models to construct a Chinese CKG, named Snowman. Specifically, we distill different types of commonsense head items from ChatGPT, and continue to use it to collect tail items with respect to the head items and pre-defined relations. Based on the preliminary analysis, we find the negative commonsense knowledge distilled by ChatGPT achieves lower human acceptance compared to other knowledge. Therefore, we design a simple yet effective self-instruct filtering strategy to filter out invalid negative commonsense. Overall, the constructed Snowman covers more than ten million Chinese commonsense triples, making it the largest Chinese CKG. Moreover, human studies show the acceptance of Snowman achieves 90.6\%, indicating the high-quality triples distilled by the cutting-edge foundation model. We also conduct experiments on commonsense knowledge models to show the usability and effectiveness of our Snowman.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。