实时的人体动作定位与跟踪的人工智能模型
A Proposed Artificial intelligence Model for Real-Time Human Action Localization and Tracking
摘要:
近年来,基于深度学习(DL)的人工智能(AI)在全球引起了极大的兴趣。DL今天被广泛使用,并已扩展到各种有趣的领域。它在跨学科研究中越来越受欢迎,例如将计算机科学与工程应用相结合的智能城市系统研究。人类行为检测就是其中之一。人体动作检测是一个有趣的挑战,由于其在计算速度和准确性方面的严格要求。高精度实时的【形】目标跟踪也被认为是一个重大挑战。本文将YOLO检测网络(被认为是最先进的实时的【形】目标检测工具)与运动矢量和Coyote优化算法(COA)相结合,构建了一个实时的【形】人体动作定位和跟踪系统。所提出的系统从压缩视频流中提取运动信息和使用对象检测器从RGB帧中提取外观信息开始。然后,在两个流之间执行融合步骤,并且将结果馈送到所提出的动作跟踪模型中。由于其准确性和快速收敛性,COA被用于目标跟踪。所提出的模型的基本基础是利用运动矢量,这已经存在于一个压缩的视频比特流,并提供足够的信息,以提高定位的目标动作,而不需要高消耗的计算资源相比,其他流行的方法提取运动信息,如光流。这一优势使得所提出的方法能够在计算资源有限的挑战性环境中实现,例如物联网(IoT)系统。
英文摘要:
In recent years, artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest. DL is widely used today and has expanded into various interesting areas. It is becoming more popular in cross-subject research, such as studies of smart city systems, which combine computer science with engineering applications. Human action detection is one of these areas. Human action detection is an interesting challenge due to its stringent requirements in terms of computing speed and accuracy. High-accuracy real-time object tracking is also considered a significant challenge. This paper integrates the YOLO detection network, which is considered a state-of-the-art tool for real-time object detection, with motion vectors and the Coyote Optimization Algorithm (COA) to construct a real-time human action localization and tracking system. The proposed system starts with the extraction of motion information from a compressed video stream and the extraction of appearance information from RGB frames using an object detector. Then, a fusion step between the two streams is performed, and the results are fed into the proposed action tracking model. The COA is used in object tracking due to its accuracy and fast convergence. The basic foundation of the proposed model is the utilization of motion vectors, which already exist in a compressed video bit stream and provide sufficient information to improve the localization of the target action without requiring high consumption of computational resources compared with other popular methods of extracting motion information, such as optical flows. This advantage allows the proposed approach to be implemented in challenging environments where the computational resources are limited, such as Internet of Things (IoT) systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。