Deep Neural Network (DNN) trained object detectors are widely deployed in many mission-critical systems for real time video analytics at the edge, such as autonomous driving and video surveillance. A common performance requirement in these mission-critical edge services is the near real-time latency of online object detection on edge devices. However, even with well-trained DNN object detectors, the online detection quality at edge may deteriorate for a number of reasons, such as limited capacity to run DNN object detection models on heterogeneous edge devices, and detection quality degradation due to random frame dropping when the detection processing rate is significantly slower than the incoming video frame rate. This paper addresses these problems by exploiting multi-model multi-device detection parallelism for fast object detection in edge systems with heterogeneous edge devices. First, we analyze the performance bottleneck of running a well-trained DNN model at edge for real time online object detection. We use the offline detection as a reference model, and examine the root cause by analyzing the mismatch among the incoming video streaming rate, video processing rate for object detection, and output rate for real time detection visualization of video streaming. Second, we study performance optimizations by exploiting multi-model detection parallelism. We show that the model-parallel detection approach can effectively speed up the FPS detection processing rate, minimizing the FPS disparity with the incoming video frame rate on heterogeneous edge devices. We evaluate the proposed approach using SSD300 and YOLOv3 on benchmark videos of different video stream rates. The results show that exploiting multi-model detection parallelism can speed up the online object detection processing rate and deliver near real-time object detection performance for efficient video analytics at edge.
A Survey on Video Analytics in Cloud-Edge-Terminal Collaborative Systems
Fudan University(复旦大学);Duke Kunshan University(昆山杜克大学);University of Toronto(多伦多大学);Imperial College London(伦敦帝国学院);University of California, Davis(加利福尼亚大学戴维斯分校);SMBU;University of Ottawa(渥太华大学)
Demonstration of a Cloud-based Software Framework for Video Analytics Application using Low-Cost IoT Devices
Redspark Technologies(红 spark 科技);Pandit Deendayal Petroleum University(潘迪特·丁代亚尔石油大学);Confirm SFI Research Centre for Smart Manufacturing, Data Science Institute, NUI Galway(爱尔兰国立高威大学数据科学研究所、爱尔兰科学基金会智能制造业确认研究中心)
Asynchronous Pipeline Parallelism for Real-Time Multilingual Lip Synchronization in Video Communication Systems
Department of Data Science;Big Data Yildiz Technical University Istanbul, Turkey;Department of Computer Engineering Yildiz Technical University Istanbul, Turkey;R\&D Center Aktif Investment Bank Inc. Istanbul, Turkey;3.5cm R\&D Center 3.5cm Aktif Investment Bank Inc. 3.5cm Istanbul, Turkey 3.5cm;0.25cm Department of Computer Engineering 0.25cm Yildiz Technical University 0.25cm Istanbul, Turkey 0.25cm
A Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental Learning
Nanyang Technological University(南洋理工大学);Wuhan University(武汉大学);Nanjing University of Science and Technology(南京理工大学);K&C Technologies Solutions(K&C技术解决方案公司)