One of the key obstacles in making learning protocols realistic in applications is the need to supervise them, a costly process that often requires hiring domain experts. We consider the framework to use the world knowledge as indirect supervision. World knowledge is general-purpose knowledge, which is not designed for any specific domain. Then the key challenges are how to adapt the world knowledge to domains and how to represent it for learning. In this paper, we provide an example of using world knowledge for domain dependent document clustering. We provide three ways to specify the world knowledge to domains by resolving the ambiguity of the entities and their types, and represent the data with world knowledge as a heterogeneous information network. Then we propose a clustering algorithm that can cluster multiple types and incorporate the sub-type information as constraints. In the experiments, we use two existing knowledge bases as our sources of world knowledge. One is Freebase, which is collaboratively collected knowledge about entities and their organizations. The other is YAGO2, a knowledge base automatically extracted from Wikipedia and maps knowledge to the linguistic knowledge base, WordNet. Experimental results on two text benchmark datasets (20newsgroups and RCV1) show that incorporating world knowledge as indirect supervision can significantly outperform the state-of-the-art clustering algorithms as well as clustering algorithms enhanced with world knowledge features.
Creating Training Sets via Weak Indirect Supervision
Microsoft Research Asia(微软亚洲研究院);University of Washington(华盛顿大学);University of Science and Technology of China(中国科学技术大学);Carnegie Mellon University(卡内基梅隆大学);Snorkel AI, Inc.(Snorkel AI公司)
DocParser: Hierarchical Structure Parsing of Document Renderings
ETH Zurich(苏黎世联邦理工学院)
翻译渲染(e. G. PDF、扫描)转换为分层文档结构,这在许多实际应用程序的日常工作中有着广泛的需求。然而,一个整体的,原则性的方法来推断完整的层次结构的文件是失踪。作为补救措施,我们开发了“DocParser”:一个端到端的系统,用于解析完整的文档结构-包括所有文本元素,嵌套的图形,表格和表格单元格结构。我们的第二个贡献是提供了一个数据集,用于评估分层文档结构解析。我们的第三个贡献是提出了一个可扩展的学习框架设置特定领域的数据是稀缺的,我们解决了一种新的方法,以弱监督,显着提高了文档结构解析性能。我们的实验证实了我们提出的弱监督的有效性:与没有弱监督的基线相比,它将检测文档实体的平均精度提高了39.1%,将分类层次关系的F1得分提高了35.8%。
Topics and Label Propagation: Best of Both Worlds for Weakly Supervised Text Classification
TCS Research, Tata Consultancy Services(塔塔咨询服务公司研究部);Indian Institute of Technology Bombay(印度理工学院孟买分校);Indian Institute of Technology Madras(印度理工学院马德拉斯分校)