Animal habitat surveys play a critical role in preserving the biodiversity of the land. One of the effective ways to gain insights into animal habitats involves identifying animal footprints, which offers valuable information about species distribution, abundance, and behavior. However, due to the scarcity of animal footprint images, there are no well-maintained public datasets, preventing recent advanced techniques in computer vision from being applied to animal tracking. In this paper, we introduce OpenAnimalTracks dataset, the first publicly available labeled dataset designed to facilitate the automated classification and detection of animal footprints. It contains various footprints from 18 wild animal species. Moreover, we build benchmarks for species classification and detection and show the potential of automated footprint identification with representative classifiers and detection models. We find SwinTransformer achieves a promising classification result, reaching 69.41% in terms of the averaged accuracy. Faster-RCNN achieves mAP of 0.295. We hope our dataset paves the way for automated animal tracking techniques, enhancing our ability to protect and manage biodiversity. Our dataset and code are available at https://github.com/dahlian00/OpenAnimalTracks.
AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wild
Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Nanjing Institute of Software Technology(南京软件技术研究院);University of North Texas(北德克萨斯大学)
3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking
University of Konstanz(康斯坦茨大学);Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Eötvös Loránd University(厄特沃什·罗兰大学);Hungarian Academy of Sciences(匈牙利科学院)
The SA-FARI Dataset: Segment Anything in Footage of Animals for Recognition and Identification
Conservation X Labs (CXL)(Conservation X Labs);Meta;University of Bristol(布里斯托大学);Hasso Plattner Institute(哈索罗滕堡研究所);University of Oviedo(奥维多大学);Osa Conservation(Osa保护);Senckenberg Museum of Natural History(Senckenberg自然史博物馆);Max Planck Institute for Evolutionary Anthropology(马克斯·普朗克进化人类学研究所);Climate Corridors(气候走廊)
Benchmarking pig detection and tracking under diverse and challenging conditions
Chair of Statistics and Econometrics, Faculty of Economics, University of Göttingen, Germany(经济学院统计与计量经济学系,乌特雷赫大学);Campus Institute Data Science(校园数据科学研究所);Institute of Animal Breeding and Husbandry, Kiel University, Germany(动物育种与饲养研究所,基尔大学);Institute of Animal Breeding(动物育种研究所);work performed during employment at University of Göttingen, Germany(在乌特雷赫大学任职期间的工作);work performed during employment at Kiel University, Germany(在基尔大学任职期间的工作)
Going Deeper than Tracking: a Survey of Computer-Vision Based Recognition of Animal Pain and Affective States
KTH Royal Institute of Technology(瑞典皇家理工学院);University of Haifa(海法大学);University of São Paulo(圣保罗大学);Swedish University of Agricultural Sciences(瑞典农业科学大学);Universiteit Utrecht(乌得勒支大学);University of Glasgow(格拉斯哥大学);Silo AI;Boğaziçi University(博阿齐奇大学)
SketchANIMAR: Sketch-based 3D Animal Fine-Grained Retrieval
University of Science, VNU-HCM(胡志明市国家大学理学院);Vietnam National University, Ho Chi Minh City(胡志明市国家大学);University of Dayton(戴顿大学);University of Information Technology, VNU-HCM(胡志明市国家大学信息技术学院)
A Computer Vision Pipeline for Individual-Level Behavior Analysis: Benchmarking on the Edinburgh Pig Dataset
Department of Animal Science, College of Agriculture and Life Sciences, Cornell University(动物科学系,农业与生命科学学院,康奈尔大学);University of Liège, Gembloux Agro-Bio Tech (ULìege-GxABT)(列日大学,吉尔伯特农业生物技术(ULiège-GxABT))
BuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopes
Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);University of Konstanz(康斯坦茨大学);Indian Institute of Science(印度科学学院);BITS Pilani Hyderabad(BITS Pilani海得拉巴校区)
3D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capture
University of Konstanz(康斯坦茨大学);Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Technische Universität München(慕尼黑工业大学);Eötvös Loránd University(厄特沃什·罗兰大学);Hungarian Academy of Sciences(匈牙利科学院)
机器学习和计算机视觉的最新进展正在彻底改变动物行为领域,使研究人员能够在没有任何标记的情况下跟踪自由移动的动物的姿势和位置。然而,用于无标记姿态跟踪的动物注释图像的大数据集,特别是从多个角度拍摄的具有准确3D注释的高分辨率图像,仍然很少。在这里,我们提出了一种方法,使用运动捕捉(mo-cap)系统,以半自动的方式获得大量的动物运动和姿势(2D和3D)的注释数据。我们的方法是新颖的,因为它提取的3D位置的形态关键点(如眼睛,喙,尾巴)在参考的位置标记附着到动物。使用这种方法,我们获得并在这里提供了一个新的数据集- 3D-POP,其中包含大约300 k注释帧(400万个实例),这些注释帧以视频的形式存在,其中包含来自3.6m x 4.2m区域中的4个不同相机视图的一到十只自由移动的鸟类。3D-POP是第一个具有2D和3D精确关键点注释以及限界框和个体身份的群集鸟类数据集,将有助于开发2D到3D无标记姿势,轨迹跟踪和鸟类识别问题的解决方案。
Motion-Driven Multi-Object Tracking of Model Organisms in Space Science Experiments
Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences(中国科学院空间利用技术与工程中心);School of Space Exploration, University of Chinese Academy of Sciences(中国科学院大学空间探索学院)
Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Images
Microsoft AI for Good Lab, Redmond(微软人工智能公益实验室);University of Southern California, Los Angeles(南加州大学);Microsoft Research, Redmond(微软研究院);Nanyang Technological University, Singapore(南洋理工大学);Universidad de Los Andes, Colombia(洛斯安第斯大学)
Algorithmic Design and Implementation of Unobtrusive Multistatic Serial LiDAR Image
University of Florida(佛罗里达大学)
为了充分了解海洋流体动力学(MHK)设备与海洋动物之间的相互作用,需要一个快速有效的监测系统,以便在水下动物出现时捕获相关信息。一种新的自动水下成像系统,由LiDAR(光探测和测距)成像硬件和一个名为Unobtrusive Multistatic Serial LiDAR Imager(UMSLI)的场景理解软件模块组成,用于监督涡轮机附近的动物是否存在。UMSLI集成了前端LiDAR硬件和一系列软件模块,以分层的方式实现图像预处理,检测,跟踪,分割和分类。