arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.04073cs.HCcs.LGstat.ML
收藏

基于多源迁移学习的开放集合众包

Open-Set Crowdsourcing using Multiple-Source Transfer Learning

Southwest University(西南大学);Shandong University(山东大学);Joint SDU-NTU Centre for Artificial Intelligence Research(山东大学-南洋理工大学人工智能联合研究中心);George Mason University(乔治梅森大学);King Abudullah University of Science and Technology(阿卜杜拉国王科技大学)

Guangyang Han, Guoxian Yu, Lei Liu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang

摘要:

我们提出并定义了一个新的众包场景,即开集众包,我们只知道一个不熟悉的众包项目的大致主题,而不知道它的标签空间,即可能的标签集合。这仍然是一个任务标注问题,但对任务和标签空间的不熟悉阻碍了任务和工人的建模,也阻碍了真值推理。我们提出了一个直观的解决方案,OSCrowd。首先,OSCrowd将人群主题相关数据集集成到一个大的源域中,以促进部分迁移学习来近似这些任务的标签空间推理。接下来,它根据类别相关性为每个源域分配权重。在此之后,它使用多源开放集迁移学习来建模人群任务并分配可能的注释。迁移学习给出的标注空间和标注将用于指导和规范人群工作者的标注。我们在一个在线场景中验证了OSCrowd,并证明了OSCrowd解决了开集众包问题,比相关的众包解决方案更好。

英文摘要:

We raise and define a new crowdsourcing scenario, open set crowdsourcing, where we only know the general theme of an unfamiliar crowdsourcing project, and we don't know its label space, that is, the set of possible labels. This is still a task annotating problem, but the unfamiliarity with the tasks and the label space hampers the modelling of the task and of workers, and also the truth inference. We propose an intuitive solution, OSCrowd. First, OSCrowd integrates crowd theme related datasets into a large source domain to facilitate partial transfer learning to approximate the label space inference of these tasks. Next, it assigns weights to each source domain based on category correlation. After this, it uses multiple-source open set transfer learning to model crowd tasks and assign possible annotations. The label space and annotations given by transfer learning will be used to guide and standardize crowd workers' annotations. We validate OSCrowd in an online scenario, and prove that OSCrowd solves the open set crowdsourcing problem, works better than related crowdsourcing solutions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑