arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.02830cs.DLcs.AIcs.HC
收藏

KnowledgeShovel:一个面向科学知识库构建的人工智能在环文档标注系统

KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction

Shanghai Jiao Tong University(上海交通大学);IBM Research(IBM研究院);University of Notre Dame(圣母大学);Chinese Academy of Sciences(中国科学院)

Shao Zhang, Yuting Jia, Hui Xu, Dakuo Wang, Toby Jia-jun Li, Ying Wen, Xinbing Wang, Chenghu Zhou

摘要:

构建全面、准确、有用的科学知识库对于人类研究人员综合科学知识和实现人工智能驱动的科学发现至关重要。然而,目前的过程是困难的,容易出错,费力的,由于(1)大量的科学文献;(2)高度专业化的科学领域;(3)信息的不同形式(文本,图,表);和,(4)不同出版物中的科学知识筒仓格式和结构不一致。知情的形成性研究和迭代与参与式设计研讨会,我们设计和开发的KnowledgeShovel,一个铝在环文档注释系统的研究人员构建科学的知识库。KnowledgeShovel的设计引入了一个多步骤多模式的人工智能协作管道,与用户现有的工作流程保持一致,以提高数据准确性,同时减少人类负担。通过对7位地学科研人员的用户跟踪评价表明,KnowledgeShovel能够高效地构建科学知识库,并具有令人满意的精度。

英文摘要:

Constructing a comprehensive, accurate, and useful scientific knowledge base is crucial for human researchers synthesizing scientific knowledge and for enabling Al-driven scientific discovery. However, the current process is difficult, error-prone, and laborious due to (1) the enormous amount of scientific literature available; (2) the highly-specialized scientific domains; (3) the diverse modalities of information (text, figure, table); and, (4) the silos of scientific knowledge in different publications with inconsistent formats and structures. Informed by a formative study and iterated with participatory design workshops, we designed and developed KnowledgeShovel, an Al-in-the-Loop document annotation system for researchers to construct scientific knowledge bases. The design of KnowledgeShovel introduces a multi-step multi-modal human-AI collaboration pipeline that aligns with users' existing workflows to improve data accuracy while reducing the human burden. A follow-up user evaluation with 7 geoscience researchers shows that KnowledgeShovel can enable efficient construction of scientific knowledge bases with satisfactory accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑