解读动物行为中的专家注释差异
Interpreting Expert Annotation Differences in Animal Behavior
摘要:
手工注释的数据可能会因主观差异、评估者内部差异和注释者专业知识不同等因素而有所不同。我们研究了来自不同专家的注释,这些专家在一组动物行为视频上标记了相同的行为类,并观察到注释风格的变化。我们提出了一种新的方法,使用程序合成,以帮助解释行为分析的注释差异。我们的模型选择相关的轨迹特征,并学习时间过滤器作为程序的一部分,这对应于注释者在每个时间戳对该特征的估计重要性。我们在行为神经科学数据集上的实验表明,与基线方法相比,我们的方法在捕获注释器标签和学习可解释的时间过滤器方面更准确。我们相信,我们的方法可以提高科学研究中使用的行为注释的可重复性。我们计划发布我们的代码。
英文摘要:
Hand-annotated data can vary due to factors such as subjective differences, intra-rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal behavior videos, and observe a variation in annotation styles. We propose a new method using program synthesis to help interpret annotation differences for behavior analysis. Our model selects relevant trajectory features and learns a temporal filter as part of a program, which corresponds to estimated importance an annotator places on that feature at each timestamp. Our experiments on a dataset from behavioral neuroscience demonstrate that compared to baseline approaches, our method is more accurate at capturing annotator labels and learns interpretable temporal filters. We believe that our method can lead to greater reproducibility of behavior annotations used in scientific studies. We plan to release our code.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。