arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.03117cs.LGstat.ML
收藏

全球和时间序列标注的联合多维模型

Joint Multi-Dimensional Model for Global and Time-Series Annotations

Anil Ramakrishna, Rahul Gupta, Shrikanth Narayanan

摘要:

众包是一种流行的方法来收集未标记的数据实例的注释。它涉及到为每个数据实例从几个通常是天真的未经训练的注释器收集大量注释,然后将其组合以估计地面实况。此外,对诸如情感之类的结构的注释通常是多维的,注释者对每个实例的多个维度进行评级,诸如效价和唤醒。然而,大多数注释融合方案忽略了这一方面,并单独对每个维度进行建模。在这项工作中,我们通过提出一个多维注释融合的生成模型来解决这个问题,该模型对维度进行建模,从而获得更准确的地面实况估计。我们提出的模型是适用于全球和时间序列的注释融合问题,并把地面真理作为一个潜在的变量扭曲的注释。使用期望最大化算法估计模型参数,并使用合成数据和真实情感语料库以及带有人类注释的人工任务来评估其性能

英文摘要:

Crowdsourcing is a popular approach to collect annotations for unlabeled data instances. It involves collecting a large number of annotations from several, often naive untrained annotators for each data instance which are then combined to estimate the ground truth. Further, annotations for constructs such as affect are often multi-dimensional with annotators rating multiple dimensions, such as valence and arousal, for each instance. Most annotation fusion schemes however ignore this aspect and model each dimension separately. In this work we address this by proposing a generative model for multi-dimensional annotation fusion, which models the dimensions jointly leading to more accurate ground truth estimates. The model we propose is applicable to both global and time series annotation fusion problems and treats the ground truth as a latent variable distorted by the annotators. The model parameters are estimated using the Expectation-Maximization algorithm and we evaluate its performance using synthetic data and real emotion corpora as well as on an artificial task with human annotations

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑