arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.13583cs.AI
收藏

科学文献中的方法和数据集实体挖掘:一个自注意的CNN + Bi-LSTM模型

Method and Dataset Entity Mining in Scientific Literature: A CNN + Bi-LSTM Model with Self-attention

Nankai University(南开大学);Zhejiang Lab(之江实验室);Tianjin University(天津大学);Alibaba Group(阿里巴巴集团);Central South University(中南大学)

Linlin Hou, Ji Zhang, Ou Wu, Ting Yu, Zhen Wang, Zhao Li, Jianliang Gao, Yingchun Ye, Rujing Yao

摘要:

文献分析有助于研究者更好地了解科学技术的发展。传统的文献分析主要关注文献元数据,如主题、作者、摘要、关键词、参考文献等,对论文的主要内容关注较少。在诸如科学、计算、工程等许多科学领域中,在这些领域发表的科学论文中所涉及的方法和数据集承载着重要的信息,对于领域分析以及算法和数据集推荐是非常有用的。在本文中,我们提出了一种新的实体识别模型,称为MDER,它能够有效地提取的方法和数据集实体的主要文本内容的科学论文。该模型利用规则嵌入,采用CNN和Bi-LSTM并行结构,并引入自注意力机制。我们在数据集上评估了所提出的模型,这些数据集是从计算机科学的四个研究领域的已发表论文中构建的,即,NLP、CV、数据采掘和人工智能。实验结果表明,我们的模型表现良好,在所有的四个领域,它具有良好的跨区域学习和识别的学习能力。我们还进行了实验,以评估我们的模型中不同的建筑模块的有效性,这表明不同的建筑模块的重要性,在集体作出贡献的良好的实体识别性能作为一个整体。在我们的模型上进行的数据增强实验表明,数据增强对模型训练有积极的贡献,使我们的模型在处理只有少量训练样本的情况下更加鲁棒。最后,我们将我们的模型应用于2009-2019年发表的PAKDD论文,从更长时间跨度内发表的科学论文中挖掘有见地的结果。

英文摘要:

Literature analysis facilitates researchers to acquire a good understanding of the development of science and technology. The traditional literature analysis focuses largely on the literature metadata such as topics, authors, abstracts, keywords, references, etc., and little attention was paid to the main content of papers. In many scientific domains such as science, computing, engineering, etc., the methods and datasets involved in the scientific papers published in those domains carry important information and are quite useful for domain analysis as well as algorithm and dataset recommendation. In this paper, we propose a novel entity recognition model, called MDER, which is able to effectively extract the method and dataset entities from the main textual content of scientific papers. The model utilizes rule embedding and adopts a parallel structure of CNN and Bi-LSTM with the self-attention mechanism. We evaluate the proposed model on datasets which are constructed from the published papers of four research areas in computer science, i.e., NLP, CV, Data Mining and AI. The experimental results demonstrate that our model performs well in all the four areas and it features a good learning capacity for cross-area learning and recognition. We also conduct experiments to evaluate the effectiveness of different building modules within our model which indicate that the importance of different building modules in collectively contributing to the good entity recognition performance as a whole. The data augmentation experiments on our model demonstrated that data augmentation positively contributes to model training, making our model much more robust in dealing with the scenarios where only small number of training samples are available. We finally apply our model on PAKDD papers published from 2009-2019 to mine insightful results from scientific papers published in a longer time span.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑