CrowdER:众包实体解析
CrowdER: Crowdsourcing Entity Resolution
摘要:
实体解析是数据集成和数据清理的核心。数学方法的质量一直在提高,但仍远未达到完美。众包平台提供了一种更准确但昂贵(且缓慢)的方式,将人类的洞察力带入这一过程。以前的工作已经提出了向人类工作者呈现的验证任务,但即使使用验证,由于要测试大量的匹配,即使是中等大小的数据集也不可行。相反,我们提出了一种混合的人机方法,其中机器用于对所有数据进行初始的粗略传递,而人则用于验证最可能的匹配对。我们表明,对于这样一个混合系统,生成的最小数量的验证任务的给定大小是NP-难的,但我们开发了一种新的两层启发式方法来创建批量任务。我们描述了这种方法,并提出了广泛的实验结果的真实数据集使用流行的众包平台。实验表明,我们的混合方法实现了良好的效率和高精度相比,只有机器或人类的替代品。
英文摘要:
Entity resolution is central to data integration and data cleaning. Algorithmic approaches have been improving in quality, but remain far from perfect. Crowdsourcing platforms offer a more accurate but expensive (and slow) way to bring human insight into the process. Previous work has proposed batching verification tasks for presentation to human workers but even with batching, a human-only approach is infeasible for data sets of even moderate size, due to the large numbers of matches to be tested. Instead, we propose a hybrid human-machine approach in which machines are used to do an initial, coarse pass over all the data, and people are used to verify only the most likely matching pairs. We show that for such a hybrid system, generating the minimum number of verification tasks of a given size is NP-Hard, but we develop a novel two-tiered heuristic approach for creating batched tasks. We describe this method, and present the results of extensive experiments on real data sets using a popular crowdsourcing platform. The experiments show that our hybrid approach achieves both good efficiency and high accuracy compared to machine-only or human-only alternatives.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。