arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.02710cs.LGcs.CV
收藏

多智能体行为数据集:小鼠二元社会互动

The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions

Caltech(加州理工学院);AICrowd Research(AICrowd研究院);Freie Universität Berlin(柏林自由大学);OPPO Research Institute(OPPO研究院);Northwestern University(西北大学)

Jennifer J. Sun, Tomomi Karigo, Dipam Chakraborty, Sharada P. Mohanty, Benjamin Wild, Quan Sun, Chen Chen, David J. Anderson, Pietro Perona, Yisong Yue, Ann Kennedy

摘要:

多智能体行为建模旨在理解智能体之间发生的交互。我们提出了一个来自行为神经科学的多智能体数据集,加州理工学院小鼠社会互动(CalMS21)数据集。我们的数据集由社会互动的轨迹数据组成,这些数据记录自标准居民入侵者测定中自由行为小鼠的视频。为了帮助加速行为研究,CalMS 21数据集提供了基准来评估自动行为分类方法在三种设置中的性能:(1)用于在所有由单个注释器注释的大型行为数据集上进行训练,(2)用于风格转移以学习行为定义中的注释器间差异,以及(3)用于在有限的训练数据下学习感兴趣的新行为。该数据集包括600万帧未标记的相互作用小鼠的跟踪姿势,以及超过100万帧的跟踪姿势和相应的帧级行为注释。我们的数据集的挑战是能够使用标记和未标记的跟踪数据准确地对行为进行分类,以及能够推广到新的设置。

英文摘要:

Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of freely behaving mice in a standard resident-intruder assay. To help accelerate behavioral studies, the CalMS21 dataset provides benchmarks to evaluate the performance of automated behavior classification methods in three settings: (1) for training on large behavioral datasets all annotated by a single annotator, (2) for style transfer to learn inter-annotator differences in behavior definitions, and (3) for learning of new behaviors of interest given limited training data. The dataset consists of 6 million frames of unlabeled tracked poses of interacting mice, as well as over 1 million frames with tracked poses and corresponding frame-level behavior annotations. The challenge of our dataset is to be able to classify behaviors accurately using both labeled and unlabeled tracking data, as well as being able to generalize to new settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑