arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1608.00104cs.LGcs.CLcs.IR
收藏

世界知识作为文档聚类的间接监督

World Knowledge as Indirect Supervision for Document Clustering

Peking University(北京大学);Hong Kong University of Science and Technology(香港科技大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Chenguang Wang, Yangqiu Song, Dan Roth, Ming Zhang, Jiawei Han

摘要:

使学习协议在应用程序中成为现实的关键障碍之一是需要监督它们,这是一个昂贵的过程,通常需要聘请领域专家。我们认为框架使用世界知识作为间接监督。世界知识是通用的知识,它不是为任何特定领域设计的。如何使世界知识适应领域,以及如何表示它以供学习,是关键的挑战。在本文中,我们提供了一个例子,使用世界知识的领域相关的文档聚类。我们提供了三种方法来指定的世界知识的领域,通过解决的实体和它们的类型的二义性,并表示与世界知识的数据作为一个异构的信息网络。然后,我们提出了一个聚类算法,可以聚类多个类型,并将子类型的信息作为约束。在实验中,我们使用两个现有的知识库作为我们的世界知识的来源。一个是Freebase,它是关于实体及其组织的协作收集的知识。另一个是YAGO2,一个从维基百科自动提取的知识库,将知识映射到语言知识库WordNet。在两个文本基准数据集(20个新闻组和RCV 1)上的实验结果表明,引入世界知识作为间接监督,可以显著优于现有的聚类算法和基于世界知识特征的聚类算法.

英文摘要:

One of the key obstacles in making learning protocols realistic in applications is the need to supervise them, a costly process that often requires hiring domain experts. We consider the framework to use the world knowledge as indirect supervision. World knowledge is general-purpose knowledge, which is not designed for any specific domain. Then the key challenges are how to adapt the world knowledge to domains and how to represent it for learning. In this paper, we provide an example of using world knowledge for domain dependent document clustering. We provide three ways to specify the world knowledge to domains by resolving the ambiguity of the entities and their types, and represent the data with world knowledge as a heterogeneous information network. Then we propose a clustering algorithm that can cluster multiple types and incorporate the sub-type information as constraints. In the experiments, we use two existing knowledge bases as our sources of world knowledge. One is Freebase, which is collaboratively collected knowledge about entities and their organizations. The other is YAGO2, a knowledge base automatically extracted from Wikipedia and maps knowledge to the linguistic knowledge base, WordNet. Experimental results on two text benchmark datasets (20newsgroups and RCV1) show that incorporating world knowledge as indirect supervision can significantly outperform the state-of-the-art clustering algorithms as well as clustering algorithms enhanced with world knowledge features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑