Tracking the behaviour of livestock enables early detection and thus prevention of contagious diseases in modern animal farms. Apart from economic gains, this would reduce the amount of antibiotics used in livestock farming which otherwise enters the human diet exasperating the epidemic of antibiotic resistance - a leading cause of death. We could use standard video cameras, available in most modern farms, to monitor livestock. However, most computer vision algorithms perform poorly on this task, primarily because, (i) animals bred in farms look identical, lacking any obvious spatial signature, (ii) none of the existing trackers are robust for long duration, and (iii) real-world conditions such as changing illumination, frequent occlusion, varying camera angles, and sizes of the animals make it hard for models to generalize. Given these challenges, we develop an end-to-end behaviour monitoring system for group-housed pigs to perform simultaneous instance level segmentation, tracking, action recognition and re-identification (STAR) tasks. We present starformer, the first end-to-end multiple-object livestock monitoring framework that learns instance-level embeddings for grouped pigs through the use of transformer architecture. For benchmarking, we present Pigtrace, a carefully curated dataset comprising video sequences with instance level bounding box, segmentation, tracking and activity classification of pigs in real indoor farming environment. Using simultaneous optimization on STAR tasks we show that starformer outperforms popular baseline models trained for individual tasks.
Tran-GCN: A Transformer-Enhanced Graph Convolutional Network for Person Re-Identification in Monitoring Videos
Faculty of Computing, Universiti Teknologi Malaysia(马来西亚理工大学计算机学院);Malaysia-Japan International Institute of Technology, Universiti Teknologi Malaysia(马来西亚理工大学马来西亚-日本国际技术学院)
A Multicore and Edge TPU-Accelerated Multimodal TinyML System for Livestock Behavior Recognition
Medical AI Lab, Hebei Provincial Engineering Research Center for AI-Based Cancer Treatment Decision-Making, The First Hospital of Hebei Medical University(医学人工智能实验室,河北省人工智能辅助癌症治疗决策工程研究中心,河北省医科大学第一医院);Computing Department, Imperial College London(计算部门,帝国理工学院伦敦分校);Professor Pervasive Sensing & TinyML and the Head of the Smart Sensing Lab at Nottingham Trent University(感知与TinyML教授及智能感知实验室主任,诺丁汉特伦特大学);Provost’s Visiting Professor in tinyML at Imperial College London(帝国理工学院伦敦分校副校长兼任TinyML客座教授)
SEMT: Static-Expansion-Mesh Transformer Network Architecture for Remote Sensing Image Captioning
Austrian Institute of Technology(奥地利技术研究院);University of Technology of Troyes(图卢兹技术大学);Ho Chi Minh University of Technology(胡志明技术大学);Ton Duc Thang University(-ton Duc Thang大学)
Cattle-CLIP: A Multimodal Framework for Dairy Cattle Behaviour Recognition from Video
Bristol Veterinary School, University of Bristol(布里斯托尔大学布里斯托尔兽医学院);School of Computer Science, University of Bristol(布里斯托尔大学计算机科学学院);Joint Institute of Qingdao Huanghai University and WeITec, Qingdao Huanghai University(青岛黄海学院与WeITec联合学院,青岛黄海学院)
CowCare: A Unified Visual Framework for Viewpoint-Robust Cattle Tracking and Spatiotemporal Heat-Stress Analysis
College of Information and Electrical Engineering, China Agricultural University(中国农业大学信息与电气工程学院);National Innovation Center for Digital Fishery, Ministry of Agriculture and Rural Affairs(农业农村部国家数字渔业创新中心);Key Laboratory of Smart Farming Technologies for Aquatic Animal and Livestock, Ministry of Agriculture and Rural Affairs(农业农村部水产动物与畜禽智慧养殖技术重点实验室);Key Laboratory of Agricultural Informatization Standardization, Ministry of Agriculture and Rural Affairs(农业农村部农业信息化标准化重点实验室)
WoundNet-Ensemble: A Novel IoMT System Integrating Self-Supervised Deep Learning and Multi-Model Fusion for Automated, High-Accuracy Wound Classification and Healing Progression Monitoring
The Catholic University of America(美国天主教大学);Center for Advanced Research in Computer Engineering(计算机工程高级研究中心)
Robust Cross-Domain WiFi Fall Detection via Physics-Driven Attention-Enhanced Transformers
National Mobile Communications Research Laboratory, Southeast University(东南大学国家移动通信研究实验室);Department of Computer Science, Brunel University London(布鲁内尔大学伦敦计算机科学系);Pervasive Communication Research Center, Purple Mountain Laboratories(紫金山实验室 pervasive 通信研究中心)