Deploying deep neural networks~(DNNs) on edge devices provides efficient and effective solutions for the real-world tasks. Edge devices have been used for collecting a large volume of data efficiently in different domains. DNNs have been an effective tool for data processing and analysis. However, designing DNNs on edge devices is challenging due to the limited computational resources and memory. To tackle this challenge, we demonstrate Object Detection System for Edge Devices~(BED) on the MAX78000 DNN accelerator. It integrates on-device DNN inference with a camera and an LCD display for image acquisition and detection exhibition, respectively. BED is a concise, effective and detailed solution, including model training, quantization, synthesis and deployment. The entire repository is open-sourced on Github, including a Graphical User Interface~(GUI) for on-chip debugging. Experiment results indicate that BED can produce accurate detection with a 300-KB tiny DNN model, which takes only 91.9 ms of inference time and 1.845 mJ of energy. The real-time detection is available at YouTube.
Video Object Recognition in Mobile Edge Networks: Local Tracking or Edge Detection?
School of Communications and Electronics Engineering, East China Normal University(电子信息工程学院,华东师范大学);School of Electronics and Information Technology, Sun Yat-sen University(电子信息技术学院,中山大学);School of Computer Science, Fudan University(计算机科学学院,复旦大学);Information Systems Technology and Design Pillar, Singapore University of Technology and Design(信息系统技术与设计学院,新加坡科技设计大学)
EdgeMA: Model Adaptation System for Real-Time Video Analytics on Edge Devices
Ping An Technology (Shenzhen) Co., Ltd.(平安科技(深圳)有限公司);Huazhong University of Science and Technology(华中科技大学);Stony Brook University(石溪大学);Hunan Chasing Financial Holdings Co., Ltd.(湖南财信金融控股集团有限公司)
Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devices
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Data Science and Analytics Thrust, HKUST (GZ)(香港科技大学(广州)数据科学与分析学域);The Chinese University of Hong Kong(香港中文大学)
Efficient Computer Vision on Edge Devices with Pipeline-Parallel Hierarchical Neural Networks
Purdue University(普渡大学);Loyola University Chicago(芝加哥洛约拉大学)
低功耗边缘设备上的计算机视觉可实现搜索救援和安全等应用。最先进的计算机视觉算法,如深度神经网络(DNN),对于低功耗边缘设备的推理来说太大了。为了提高效率,一些现有方法跨多个边缘设备并行化DNN推理。然而,这些技术引入了显著的通信和同步开销,或者无法跨设备平衡工作负载。本文证明了分层DNN架构非常适合多个边缘设备上的并行处理。我们设计了一种新的方法,创建一个并行推理流水线的计算机视觉问题,使用分层DNN。该方法平衡了协作设备之间的负载,并降低了通信成本,以便于以更高的吞吐量同时处理多个视频帧。我们的实验考虑了一个代表性的计算机视觉问题,其中在多个Raspberry Pi 4B上运行的每个视频帧上执行图像识别。通过四个协作的低功耗边缘设备,与现有的单设备分层DNN相比,我们的方法实现了3.21倍的吞吐量,每帧每设备能耗减少68%,内存减少58%。