arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.02831cs.CV
收藏

基于部分建议网络的多鼠检测与跟踪

Detection and Tracking of Multiple Mice Using Part Proposal Networks

Lancaster University(兰卡斯特大学);University of Leicester(莱斯特大学);Xidian University(西安电子科技大学);Shenzhen NS-Tech Co.Ltd.(深圳新思科技有限公司);Queen’s University Belfast(贝尔法斯特女王大学);University of California at Merced(加州大学默塞德分校)

Zheheng Jiang, Zhihua Liu, Long Chen, Lei Tong, Xiangrong Zhang, Xiangyuan Lan, Danny Crookes, Ming-Hsuan Yang, Huiyu Zhou

摘要:

在神经科学研究中,对小鼠社会行为的研究越来越多。然而,从互动小鼠的视频中自动量化小鼠行为仍然是一个具有挑战性的问题,其中对象跟踪在定位小鼠的生活空间中起着关键作用。在动态环境中,人工标记常被用于多个小鼠的跟踪,这是侵入性的,从而干扰小鼠的运动。在本文中,我们提出了一种新的方法来连续跟踪几只老鼠和个别部分,而不需要任何特定的标记。首先,我们提出了一个高效和鲁棒的基于深度学习的鼠标部分检测方案来生成候选部分。随后,我们提出了一种新的贝叶斯非线性规划模型,该模型联合分配的部分候选人与必要的几何约束,同时建立检测到的部分之间的成对关联的个别目标。在研究社区中没有公开可用的数据集为多只小鼠的部分检测和跟踪提供定量测试平台,我们在这里介绍一个新的具有挑战性的Multi-Mice PartsTrack数据集,它由复杂的行为和动作组成。最后,我们根据新数据集上的几个基线评估了我们提出的方法,结果表明我们的方法在准确性方面优于其他最先进的方法。

英文摘要:

The study of mouse social behaviours has been increasingly undertaken in neuroscience research. However, automated quantification of mouse behaviours from the videos of interacting mice is still a challenging problem, where object tracking plays a key role in locating mice in their living spaces. Artificial markers are often applied for multiple mice tracking, which are intrusive and consequently interfere with the movements of mice in a dynamic environment. In this paper, we propose a novel method to continuously track several mice and individual parts without requiring any specific tagging. Firstly, we propose an efficient and robust deep learning based mouse part detection scheme to generate part candidates. Subsequently, we propose a novel Bayesian Integer Linear Programming Model that jointly assigns the part candidates to individual targets with necessary geometric constraints whilst establishing pair-wise association between the detected parts. There is no publicly available dataset in the research community that provides a quantitative test-bed for the part detection and tracking of multiple mice, and we here introduce a new challenging Multi-Mice PartsTrack dataset that is made of complex behaviours and actions. Finally, we evaluate our proposed approach against several baselines on our new datasets, where the results show that our method outperforms the other state-of-the-art approaches in terms of accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑