arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.09711cs.CV
收藏

AnimalFormer:用于基于行为的精准畜牧业的多模态视觉框架

AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming

Tibbling Technologies(蒂布林科技)

Ahmed Qazi, Taha Razzaq, Asim Iqbal

AI总结:

本文提出 AnimalFormer 多模态视觉框架,融合 GroundingDINO、HQSAM 与 ViTPose,从视频中实现无标签牲畜检测、分割、姿态估计及行为分析。

摘要:

我们提出了一个面向精准畜牧业的多模态视觉框架,利用 GroundingDINO、HQSAM 和 ViTPose 模型的能力。这一集成套件能够在不使用侵入性动物标签的情况下,从视频数据中进行全面的行为分析。GroundingDINO 围绕牲畜生成准确的边界框,而 HQSAM 在这些框内分割单个动物。ViTPose 估计身体关键点,从而促进姿势和运动分析。我们在一个包含吃草、奔跑、坐、站立和行走活动的绵羊数据集上进行了演示,该框架提取了宝贵的洞见:活动和吃草模式、互动动态以及详细的姿势评估。该框架适用于不同物种和视频分辨率,革新了用于活动检测、计数、健康评估和姿势分析的非侵入式牲畜监测。它通过 AI 驱动的行为理解,赋能数据驱动的农场管理,优化动物福利和生产力。

英文摘要:

We introduce a multimodal vision framework for precision livestock farming, harnessing the power of GroundingDINO, HQSAM, and ViTPose models. This integrated suite enables comprehensive behavioral analytics from video data without invasive animal tagging. GroundingDINO generates accurate bounding boxes around livestock, while HQSAM segments individual animals within these boxes. ViTPose estimates key body points, facilitating posture and movement analysis. Demonstrated on a sheep dataset with grazing, running, sitting, standing, and walking activities, our framework extracts invaluable insights: activity and grazing patterns, interaction dynamics, and detailed postural evaluations. Applicable across species and video resolutions, this framework revolutionizes non-invasive livestock monitoring for activity detection, counting, health assessments, and posture analyses. It empowers data-driven farm management, optimizing animal welfare and productivity through AI-powered behavioral understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑