Ev-Edge:在商用边缘平台上高效执行事件相机视觉算法
Ev-Edge: Efficient Execution of Event-based Vision Algorithms on Commodity Edge Platforms
AI总结:
针对事件流与异构边缘硬件不匹配导致性能不佳的问题,提出Ev-Edge框架,通过稀疏帧转换、动态聚合和并发任务映射三项优化,显著降低了延迟和能耗。
摘要:
事件相机因其高时间分辨率、高动态范围和可忽略的运动模糊,已成为自主导航系统极具前景的传感模态。为了处理此类传感器产生的异步时间事件流,近期研究表明,混合使用人工神经网络(ANN)、脉冲神经网络(SNN)以及SNN-ANN混合算法对于在多种感知任务中实现高精度是必要的。然而,我们观察到,在配备CPU、GPU和神经加速器等异构处理单元的商用边缘平台上执行此类工作负载会导致性能不佳。这是由于事件流的不规则特性和算法的多样特征与底层硬件平台之间存在不匹配。我们提出了Ev-Edge,这是一个包含三项关键优化以提升边缘平台上事件视觉系统性能的框架:(1)Event2Sparse Frame转换器直接将原始事件流转换为稀疏帧,从而能够以最小的编码开销使用稀疏库;(2)动态稀疏帧聚合器在运行时通过权衡事件的时间粒度与计算需求来合并稀疏帧,从而提高硬件利用率;(3)网络映射器将并发执行的任务映射到不同的处理单元,同时通过综合考虑计算和通信开销来选择层精度。在用于多种自主导航任务的多个最先进网络上,在NVIDIA Jetson Xavier AGX平台的单任务执行场景中,与全GPU实现相比,Ev-Edge实现了1.28倍至2.05倍的延迟改善和1.23倍至2.15倍的能耗改善。在多任务执行场景中,Ev-Edge还实现了比轮询调度方法1.43倍至1.81倍的延迟改善。
英文摘要:
Event cameras have emerged as a promising sensing modality for autonomous navigation systems, owing to their high temporal resolution, high dynamic range and negligible motion blur. To process the asynchronous temporal event streams from such sensors, recent research has shown that a mix of Artificial Neural Networks (ANNs), Spiking Neural Networks (SNNs) as well as hybrid SNN-ANN algorithms are necessary to achieve high accuracies across a range of perception tasks. However, we observe that executing such workloads on commodity edge platforms which feature heterogeneous processing elements such as CPUs, GPUs and neural accelerators results in inferior performance. This is due to the mismatch between the irregular nature of event streams and diverse characteristics of algorithms on the one hand and the underlying hardware platform on the other. We propose Ev-Edge, a framework that contains three key optimizations to boost the performance of event-based vision systems on edge platforms: (1) An Event2Sparse Frame converter directly transforms raw event streams into sparse frames, enabling the use of sparse libraries with minimal encoding overheads (2) A Dynamic Sparse Frame Aggregator merges sparse frames at runtime by trading off the temporal granularity of events and computational demand thereby improving hardware utilization (3) A Network Mapper maps concurrently executing tasks to different processing elements while also selecting layer precision by considering both compute and communication overheads. On several state-of-art networks for a range of autonomous navigation tasks, Ev-Edge achieves 1.28x-2.05x improvements in latency and 1.23x-2.15x in energy over an all-GPU implementation on the NVIDIA Jetson Xavier AGX platform for single-task execution scenarios. Ev-Edge also achieves 1.43x-1.81x latency improvements over round-robin scheduling methods in multi-task execution scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。