AlphaChimp:黑猩猩的追踪与行为识别
AlphaChimp: Tracking and Behavior Recognition of Chimpanzees
AI总结:
本研究提出AlphaChimp,一种结合时间特征融合与Transformer自注意力的端到端方法,用于黑猩猩的检测、追踪与行为识别,在追踪和行为识别上分别比现有最优方法提升约10%和20%,尤其擅长社会行为识别,并开源代码与模型。
摘要:
理解非人灵长类动物的行为对于改善动物福利、模拟社会行为以及深入了解人类独有和共有的行为至关重要。尽管计算机视觉领域近期取得了进展,但由于灵长类动物社会互动的复杂性以及缺乏专门算法,其行为的自动化分析仍然具有挑战性。现有方法常常难以应对灵长类社会动态中特有的细微行为和频繁遮挡。本研究旨在开发一种有效的方法,用于在视频片段中自动检测、追踪和识别黑猩猩的行为。我们在此表明,我们提出的方法AlphaChimp,一种端到端的方法,能够同时检测黑猩猩的位置并从视频中估计行为类别,在行为识别方面显著优于现有方法。与最先进的方法相比,AlphaChimp在追踪准确率上提高了约10%,在行为识别上提高了20%,尤其是在社会行为的识别方面表现出色。这种优越的性能源于AlphaChimp的创新架构,该架构将时间特征融合与基于Transformer的自注意力机制相结合,从而能够更有效地捕获和解释黑猩猩之间复杂的社会互动。我们的方法弥合了计算机视觉与灵长类动物学之间的鸿沟,增强了技术能力,并加深了我们对灵长类动物交流和社会性的理解。我们发布了我们的代码和模型,希望这将促进未来在动物社会动态方面的研究。这项工作为动物行为学、认知科学和人工智能做出了贡献,为社会智能提供了新的视角。
英文摘要:
Understanding non-human primate behavior is crucial for improving animal welfare, modeling social behavior, and gaining insights into both distinctly human and shared behaviors. Despite recent advances in computer vision, automated analysis of primate behavior remains challenging due to the complexity of their social interactions and the lack of specialized algorithms. Existing methods often struggle with the nuanced behaviors and frequent occlusions characteristic of primate social dynamics. This study aims to develop an effective method for automated detection, tracking, and recognition of chimpanzee behaviors in video footage. Here we show that our proposed method, AlphaChimp, an end-to-end approach that simultaneously detects chimpanzee positions and estimates behavior categories from videos, significantly outperforms existing methods in behavior recognition. AlphaChimp achieves approximately 10% higher tracking accuracy and a 20% improvement in behavior recognition compared to state-of-the-art methods, particularly excelling in the recognition of social behaviors. This superior performance stems from AlphaChimp's innovative architecture, which integrates temporal feature fusion with a Transformer-based self-attention mechanism, enabling more effective capture and interpretation of complex social interactions among chimpanzees. Our approach bridges the gap between computer vision and primatology, enhancing technical capabilities and deepening our understanding of primate communication and sociality. We release our code and models and hope this will facilitate future research in animal social dynamics. This work contributes to ethology, cognitive science, and artificial intelligence, offering new perspectives on social intelligence.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。