arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.03319cs.CV
收藏

基于深度视觉算法的群体行为跟踪

Swarm behavior tracking based on a deep vision algorithm

Xiamen University(厦门大学)

Meihong Wu, Xiaoyan Cao, Shihui Guo

摘要:

社会性昆虫(如蚂蚁)的智能群体行为在不同的环境中涌现,有望为具身智能的研究提供新的见解。研究群体行为需要研究人员能够随着时间的推移准确地跟踪每个个体。显然,在视频中手动标记单个昆虫是劳动密集型的。然而,自动跟踪方法也带来了严重的挑战:(1)个体较小且外观相似;(2)彼此之间的频繁交互会导致严重和长期的闭塞。随着人工智能和计算视觉技术的发展,我们希望提供一种自动监测多种昆虫的工具来解决上述挑战。本文提出了一种视频中多蚂蚁跟踪的检测与跟踪框架:(1)采用以ResNet-50为骨干的两阶段目标检测框架,对感兴趣区域的位置进行编码,实现蚂蚁的准确定位;(2)利用ResNet模型开发蚂蚁的外观描述符;(3)构造长时外观序列,并结合运动信息实现在线跟踪。为了验证我们的方法,我们构建了一个蚂蚁数据库,包括10个视频的蚂蚁从不同的室内和室外场景。在室内视频中,我们实现了95.7mMOTA和81.1mMOTP的最佳性能;在室外视频中,我们实现了81.8mMOTA和81.9mMOTP的最佳性能。此外,我们的方法比现有的昆虫跟踪方法快6-10倍。实验结果表明,我们的方法提供了一个强大的工具,加快解开的社会性昆虫的群体行为的机制。

英文摘要:

The intelligent swarm behavior of social insects (such as ants) springs up in different environments, promising to provide insights for the study of embodied intelligence. Researching swarm behavior requires that researchers could accurately track each individual over time. Obviously, manually labeling individual insects in a video is labor-intensive. Automatic tracking methods, however, also poses serious challenges: (1) individuals are small and similar in appearance; (2) frequent interactions with each other cause severe and long-term occlusion. With the advances of artificial intelligence and computing vision technologies, we are hopeful to provide a tool to automate monitor multiple insects to address the above challenges. In this paper, we propose a detection and tracking framework for multi-ant tracking in the videos by: (1) adopting a two-stage object detection framework using ResNet-50 as backbone and coding the position of regions of interest to locate ants accurately; (2) using the ResNet model to develop the appearance descriptors of ants; (3) constructing long-term appearance sequences and combining them with motion information to achieve online tracking. To validate our method, we construct an ant database including 10 videos of ants from different indoor and outdoor scenes. We achieve a state-of-the-art performance of 95.7\% mMOTA and 81.1\% mMOTP in indoor videos, 81.8\% mMOTA and 81.9\% mMOTP in outdoor videos. Additionally, Our method runs 6-10 times faster than existing methods for insect tracking. Experimental results demonstrate that our method provides a powerful tool for accelerating the unraveling of the mechanisms underlying the swarm behavior of social insects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑