arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.08237cs.CL
收藏

通过突发信息网络构建和解密实现协调文本流的对齐

Aligning Coordinated Text Streams through Burst Information Network Construction and Decipherment

Peking University(北京大学);Facebook, Inc.(Facebook公司);Rensselaer Polytechnic Institute(伦斯勒理工学院);Microsoft Research(微软研究院)

Tao Ge, Qing Dou, Xiaoman Pan, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou

摘要:

对齐来自多个来源和多种语言的协调文本流为跨语言知识发现开辟了许多新的研究场所。在本文中,我们的目标是推进国家的最先进的:(1)。将粗粒度的主题级知识挖掘扩展到实体和事件等细粒度信息单元;(2).遵循新的数据到网络到知识(D2 N2 K)范例来构建和利用网络结构来捕获和传播可靠的证据。我们介绍了一种新的突发信息网络(BINet)表示,可以显示最重要的信息,并说明在语料库中的突发实体,事件和关键字之间的连接。我们提出了一种有效的方法来构建和破译BINets,结合新的标准的基础上,从发音,翻译,突发,邻居和图形拓扑结构的多维线索。在中英文协同文本流上的实验结果表明,该算法能够准确地破译BINets中的高置信度节点,并且算法能够高效地并行运行,从而使其能够应用于海量流数据的无休止语言和信息破译。

英文摘要:

Aligning coordinated text streams from multiple sources and multiple languages has opened many new research venues on cross-lingual knowledge discovery. In this paper we aim to advance state-of-the-art by: (1). extending coarse-grained topic-level knowledge mining to fine-grained information units such as entities and events; (2). following a novel Data-to-Network-to-Knowledge (D2N2K) paradigm to construct and utilize network structures to capture and propagate reliable evidence. We introduce a novel Burst Information Network (BINet) representation that can display the most important information and illustrate the connections among bursty entities, events and keywords in the corpus. We propose an effective approach to construct and decipher BINets, incorporating novel criteria based on multi-dimensional clues from pronunciation, translation, burst, neighbor and graph topological structure. The experimental results on Chinese and English coordinated text streams show that our approach can accurately decipher the nodes with high confidence in the BINets and that the algorithm can be efficiently run in parallel, which makes it possible to apply it to huge amounts of streaming data for never-ending language and information decipherment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑