arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1504.04770cs.CLcs.LG
收藏

基于精简特征集的关系抽取在线推理

Online Inference for Relation Extraction with a Reduced Feature Set

University of California, Berkeley(加州大学伯克利分校);Amazon(亚马逊);Xerox Research Centre Europe(施乐欧洲研究中心)

Maxim Rabinovich, Cédric Archambeau

摘要:

访问网络规模的语料库正逐渐带来强大的自动知识库创建和扩展触手可及。为了利用这些大型的未注释的-而且极难注释的-语料库,需要无监督的机器学习方法。文本的概率模型最近作为这样一种工具取得了一些成功,但可扩展性仍然是其应用中的一个障碍,标准方法依赖于已知难以扩展的采样方案。因此,在这份报告中,我们提出了一个经验评估的次线性时间稀疏随机变分推理(SSVI)计划适用于RelLDA。我们表明,在线推理导致相对较强的定性结果,但也确定了它的一些病理-和那些模型-这将需要克服,如果SSVI是用于大规模的关系抽取。

英文摘要:

Access to web-scale corpora is gradually bringing robust automatic knowledge base creation and extension within reach. To exploit these large unannotated---and extremely difficult to annotate---corpora, unsupervised machine learning methods are required. Probabilistic models of text have recently found some success as such a tool, but scalability remains an obstacle in their application, with standard approaches relying on sampling schemes that are known to be difficult to scale. In this report, we therefore present an empirical assessment of the sublinear time sparse stochastic variational inference (SSVI) scheme applied to RelLDA. We demonstrate that online inference leads to relatively strong qualitative results but also identify some of its pathologies---and those of the model---which will need to be overcome if SSVI is to be used for large-scale relation extraction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑