arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.06317cs.CVcs.LG
收藏

基于结构简化的高效点云图神经网络

Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification

University of Cambridge(剑桥大学);Arm ML Research Lab(Arm机器学习研究实验室)

Shyam A. Tailor, René de Jong, Tiago Azevedo, Matthew Mattina, Partha Maji

摘要:

近年来,基于图神经网络(GNN)的方法已成为处理点云数据的流行策略,在各种任务上定期实现最先进的性能。到目前为止,研究界主要关注于提高模型的表现力,其次考虑如何设计可以在资源受限的移动设备(包括智能手机或混合现实耳机)上有效运行的模型。在这项工作中,我们通过观察这些GNN模型受到其第一层特征提取层的代表性能力的严重限制,朝着提高这些模型的效率迈出了一步。我们发现,这是可能的,从根本上简化这些模型,只要保留特征提取层与模型性能的最小退化;此外,我们发现,这是可能的,以提高整体性能ModelNet40和S3DIS通过改进的特征提取器的设计。对于DGCNN等模型中的图形层,我们的方法将内存消耗减少了20 $\times$,延迟减少了9.9 $\times$;总体而言,我们实现了高达4.5 $\times$的加速和72.5%的峰值内存减少。

英文摘要:

In recent years graph neural network (GNN)-based approaches have become a popular strategy for processing point cloud data, regularly achieving state-of-the-art performance on a variety of tasks. To date, the research community has primarily focused on improving model expressiveness, with secondary thought given to how to design models that can run efficiently on resource constrained mobile devices including smartphones or mixed reality headsets. In this work we make a step towards improving the efficiency of these models by making the observation that these GNN models are heavily limited by the representational power of their first, feature extracting, layer. We find that it is possible to radically simplify these models so long as the feature extraction layer is retained with minimal degradation to model performance; further, we discover that it is possible to improve performance overall on ModelNet40 and S3DIS by improving the design of the feature extractor. Our approach reduces memory consumption by 20$\times$ and latency by up to 9.9$\times$ for graph layers in models such as DGCNN; overall, we achieve speed-ups of up to 4.5$\times$ and peak memory reductions of 72.5%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑