arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1508.01951cs.LGcs.DB
收藏

人群访问路径优化:多样性至关重要

Crowd Access Path Optimization: Diversity Matters

ETH Zurich(苏黎世联邦理工学院);Brown University(布朗大学);Microsoft Research(微软研究院)

Besmira Nushi, Adish Singla, Anja Gruenheid, Erfan Zamanian, Andreas Krause, Donald Kossmann

摘要:

质量保证是众包最重要的挑战之一。如果询问同质来源,则将任务分配给几个工作人员以通过冗余答案来提高质量可能是昂贵的。目前的众包平台忽略了这一限制,因此导致昂贵的解决方案。为了实现理想的成本-质量权衡,必须应用有效的人群访问优化技术。我们的工作认为,优化需要意识到的多样性和相关性的个人群体内的信息,使众包冗余可以事先充分规划。基于这个直观的想法,我们引入了访问路径模型(APM),一种新颖的人群模型,利用访问路径的概念作为检索信息的另一种方式。APM汇总答案,确保高质量和有意义的信心。此外,我们设计了一个贪婪的优化算法,这个模型,找到一个可证明的好的近似计划,以访问人群。我们在三个众包数据集上评估我们的方法,这些数据集说明了问题的各个方面。我们的研究结果表明,结合贪婪优化的访问路径模型是成本效益和实用的,以克服常见的困难,在大规模众包,如数据稀疏性和匿名性。

英文摘要:

Quality assurance is one the most important challenges in crowdsourcing. Assigning tasks to several workers to increase quality through redundant answers can be expensive if asking homogeneous sources. This limitation has been overlooked by current crowdsourcing platforms resulting therefore in costly solutions. In order to achieve desirable cost-quality tradeoffs it is essential to apply efficient crowd access optimization techniques. Our work argues that optimization needs to be aware of diversity and correlation of information within groups of individuals so that crowdsourcing redundancy can be adequately planned beforehand. Based on this intuitive idea, we introduce the Access Path Model (APM), a novel crowd model that leverages the notion of access paths as an alternative way of retrieving information. APM aggregates answers ensuring high quality and meaningful confidence. Moreover, we devise a greedy optimization algorithm for this model that finds a provably good approximate plan to access the crowd. We evaluate our approach on three crowdsourced datasets that illustrate various aspects of the problem. Our results show that the Access Path Model combined with greedy optimization is cost-efficient and practical to overcome common difficulties in large-scale crowdsourcing like data sparsity and anonymity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑