arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.00801cs.CVcs.AI
收藏

用Transformer进行牲畜监测

Livestock Monitoring with Transformer

Transmute AI Lab(转化人工智能实验室);Serket-Tech(Serket-Tech公司);University of Amsterdam(阿姆斯特丹大学)

Bhavesh Tangirala, Ishan Bhandari, Daniel Laszlo, Deepak K. Gupta, Rajat M. Thomas, Devanshu Arya

摘要:

跟踪牲畜的行为可以早期发现,从而预防现代动物农场中的传染病。除了经济收益外,这将减少畜牧业中使用的抗生素数量,否则这些抗生素将进入人类饮食,加剧抗生素耐药性的流行-这是死亡的主要原因。我们可以使用标准的摄像机,在大多数现代农场都可以使用,来监控牲畜。然而,大多数计算机视觉算法在这项任务上表现不佳,主要是因为:(i)农场饲养的动物看起来完全相同,缺乏任何明显的空间特征;(ii)现有的跟踪器都不能长时间保持稳定;(iii)现实世界的条件,如不断变化的照明,频繁的遮挡,不同的相机角度和动物的大小,使得模型难以推广。鉴于这些挑战,我们开发了一个端到端的行为监测系统,用于群养猪,以执行同步的实例级分割,跟踪,动作识别和重新识别(STAR)任务。我们提出了starformer,第一个端到端的多对象牲畜监测框架,学习实例级嵌入分组猪通过使用Transformer架构。对于基准测试,我们提出了Pigtrace,一个精心策划的数据集,包括视频序列与实例级限界框,分割,跟踪和活动分类的猪在真实的室内养殖环境。通过对STAR任务进行同步优化,我们发现starformer的性能优于针对单个任务训练的流行基线模型。

英文摘要:

Tracking the behaviour of livestock enables early detection and thus prevention of contagious diseases in modern animal farms. Apart from economic gains, this would reduce the amount of antibiotics used in livestock farming which otherwise enters the human diet exasperating the epidemic of antibiotic resistance - a leading cause of death. We could use standard video cameras, available in most modern farms, to monitor livestock. However, most computer vision algorithms perform poorly on this task, primarily because, (i) animals bred in farms look identical, lacking any obvious spatial signature, (ii) none of the existing trackers are robust for long duration, and (iii) real-world conditions such as changing illumination, frequent occlusion, varying camera angles, and sizes of the animals make it hard for models to generalize. Given these challenges, we develop an end-to-end behaviour monitoring system for group-housed pigs to perform simultaneous instance level segmentation, tracking, action recognition and re-identification (STAR) tasks. We present starformer, the first end-to-end multiple-object livestock monitoring framework that learns instance-level embeddings for grouped pigs through the use of transformer architecture. For benchmarking, we present Pigtrace, a carefully curated dataset comprising video sequences with instance level bounding box, segmentation, tracking and activity classification of pigs in real indoor farming environment. Using simultaneous optimization on STAR tasks we show that starformer outperforms popular baseline models trained for individual tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑