Moby:赋能2D模型实现边缘高效点云分析
Moby: Empowering 2D Models for Efficient Point Cloud Analytics on the Edge
AI总结:
Moby系统利用2D检测结果推断3D边界框,并设计帧卸载调度器,在边缘设备上实现高效点云分析,相比最先进方法延迟降低高达91.9%。
摘要:
3D目标检测在许多应用中扮演着关键角色,尤其是在自动驾驶和机器人领域。这些应用通常部署在边缘设备上,以便与环境快速交互,并且往往需要接近实时的响应。由于计算能力有限,在边缘设备上使用高度复杂的神经网络执行3D检测具有挑战性。常见的解决方案如将任务卸载到云端,会因传输过程中大量的点云数据而引入显著的延迟开销。为了解决弱小的边缘设备与计算密集型推理工作负载之间的矛盾,我们探索了利用快速的2D检测来推断3D边界框的可能性。为此,我们提出了Moby,一个新颖的系统,展示了我们方法的可行性和潜力。我们为Moby设计了一个转换流水线,该流水线基于2D检测结果高效且准确地生成3D边界框,而无需运行3D检测器。此外,我们设计了一个帧卸载调度器,决定何时在云端明智地启动3D检测器,以避免误差累积。在NVIDIA Jetson TX2上使用真实自动驾驶数据集进行的广泛评估表明,与最先进的方法相比,Moby在适度精度损失的情况下,提供了高达91.9%的延迟改进。
英文摘要:
3D object detection plays a pivotal role in many applications, most notably autonomous driving and robotics. These applications are commonly deployed on edge devices to promptly interact with the environment, and often require near real-time response. With limited computation power, it is challenging to execute 3D detection on the edge using highly complex neural networks. Common approaches such as offloading to the cloud induce significant latency overheads due to the large amount of point cloud data during transmission. To resolve the tension between wimpy edge devices and compute-intensive inference workloads, we explore the possibility of empowering fast 2D detection to extrapolate 3D bounding boxes. To this end, we present Moby, a novel system that demonstrates the feasibility and potential of our approach. We design a transformation pipeline for Moby that generates 3D bounding boxes efficiently and accurately based on 2D detection results without running 3D detectors. Further, we devise a frame offloading scheduler that decides when to launch the 3D detector judiciously in the cloud to avoid the errors from accumulating. Extensive evaluations on NVIDIA Jetson TX2 with real-world autonomous driving datasets demonstrate that Moby offers up to 91.9% latency improvement with modest accuracy loss over state of the art.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。