arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.12563cs.DCcs.CV
收藏

并行检测在边缘实现高效的视频分析

Parallel Detection for Efficient Video Analytics at the Edge

Georgia Institute of Technology(佐治亚理工学院);Cisco Systems, Inc.(思科系统公司)

Yanzhao Wu, Ling Liu, Ramana Kompella

摘要:

深度神经网络(DNN)训练的对象检测器广泛部署在许多关键任务系统中,用于边缘的实时的视频分析,例如自动驾驶和视频监控。这些任务关键型边缘服务的一个常见性能要求是边缘设备上在线目标检测的近实时延迟。然而,即使使用经过良好训练的DNN对象检测器,边缘处的在线检测质量也可能由于多种原因而劣化,诸如在异构边缘设备上运行DNN目标检测模型的有限容量,以及当检测处理速率显著慢于传入视频帧速率时由于随机帧丢弃而导致的检测质量劣化。本文通过利用多模型多设备检测并行性在具有异构边缘设备的边缘系统中进行快速目标检测来解决这些问题。首先,我们分析了在边缘运行经过良好训练的DNN模型进行实时的在线目标检测的性能瓶颈。我们使用离线检测作为参考模型,并通过分析输入视频流速率、用于目标检测的视频处理速率和用于视频流的实时的检测可视化的输出速率之间的不匹配来检查根本原因。其次,我们研究了利用多模型检测并行性的性能优化。我们表明,模型并行检测方法可以有效地加快FPS检测处理速率,最大限度地减少FPS视差与输入视频帧速率上异构边缘设备。我们使用SSD300和YOLOv3对不同视频流速率的基准视频评估所提出的方法。结果表明,利用多模型检测并行性可以加快在线目标检测处理速度,并提供近实时的目标检测性能,以实现边缘的高效视频分析。

英文摘要:

Deep Neural Network (DNN) trained object detectors are widely deployed in many mission-critical systems for real time video analytics at the edge, such as autonomous driving and video surveillance. A common performance requirement in these mission-critical edge services is the near real-time latency of online object detection on edge devices. However, even with well-trained DNN object detectors, the online detection quality at edge may deteriorate for a number of reasons, such as limited capacity to run DNN object detection models on heterogeneous edge devices, and detection quality degradation due to random frame dropping when the detection processing rate is significantly slower than the incoming video frame rate. This paper addresses these problems by exploiting multi-model multi-device detection parallelism for fast object detection in edge systems with heterogeneous edge devices. First, we analyze the performance bottleneck of running a well-trained DNN model at edge for real time online object detection. We use the offline detection as a reference model, and examine the root cause by analyzing the mismatch among the incoming video streaming rate, video processing rate for object detection, and output rate for real time detection visualization of video streaming. Second, we study performance optimizations by exploiting multi-model detection parallelism. We show that the model-parallel detection approach can effectively speed up the FPS detection processing rate, minimizing the FPS disparity with the incoming video frame rate on heterogeneous edge devices. We evaluate the proposed approach using SSD300 and YOLOv3 on benchmark videos of different video stream rates. The results show that exploiting multi-model detection parallelism can speed up the online object detection processing rate and deliver near real-time object detection performance for efficient video analytics at edge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑