arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.13639cs.CL
收藏

Capturing Global Informativeness in Open Domain Keyphrase Extraction

Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);Microsoft Research(微软研究院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for Artificial Intelligence, Tsinghua University(清华大学人工智能研究院);Department of Computer Science and Technology, Northeastern University(东北大学计算机科学与技术系)

Si Sun, Zhenghao Liu, Chenyan Xiong, Zhiyuan Liu, Jie Bao

英文摘要:

Open-domain KeyPhrase Extraction (KPE) aims to extract keyphrases from documents without domain or quality restrictions, e.g., web pages with variant domains and qualities. Recently, neural methods have shown promising results in many KPE tasks due to their powerful capacity for modeling contextual semantics of the given documents. However, we empirically show that most neural KPE methods prefer to extract keyphrases with good phraseness, such as short and entity-style n-grams, instead of globally informative keyphrases from open-domain documents. This paper presents JointKPE, an open-domain KPE architecture built on pre-trained language models, which can capture both local phraseness and global informativeness when extracting keyphrases. JointKPE learns to rank keyphrases by estimating their informativeness in the entire document and is jointly trained on the keyphrase chunking task to guarantee the phraseness of keyphrase candidates. Experiments on two large KPE datasets with diverse domains, OpenKP and KP20k, demonstrate the effectiveness of JointKPE on different pre-trained variants in open-domain scenarios. Further analyses reveal the significant advantages of JointKPE in predicting long and non-entity keyphrases, which are challenging for previous neural KPE methods. Our code is publicly available at https://github.com/thunlp/BERT-KPE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑