arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.18232cs.CV
收藏

LION:用于点云中3D目标检测的线性分组RNN

LION: Linear Group RNN for 3D Object Detection in Point Clouds

Huazhong University of Science and Technology(华中科技大学);The University of Hong Kong(香港大学);Baidu Inc.(百度公司)

Zhe Liu, Jinghua Hou, Xinyu Wang, Xiaoqing Ye, Jingdong Wang, Hengshuang Zhao, Xiang Bai

AI总结:

针对Transformer在3D点云感知中计算成本高的问题,提出基于线性分组RNN的窗口框架LION,通过引入3D空间特征描述符和体素生成策略增强空间建模与稀疏特征,在多个数据集上达到SOTA。

摘要:

在大规模3D点云感知任务(如3D目标检测)中,Transformer的优势受限于其在建模长距离关系时的二次计算开销。相比之下,线性RNN具有较低的计算复杂度,适合长距离建模。为此,我们提出了一种简单有效的、基于窗口的框架,该框架建立在线性分组RNN之上(即对分组特征执行线性RNN),用于精确的3D目标检测,称为LION。其关键特性是允许在比基于Transformer的方法大得多的组中进行充分的特征交互。然而,由于在处理空间建模方面的局限性,将线性分组RNN有效应用于高度稀疏点云中的3D目标检测并非易事。为了解决这个问题,我们引入了一种3D空间特征描述符,并将其集成到线性分组RNN算子中以增强其空间特征,而不是盲目增加体素特征的扫描顺序数量。为了进一步应对高度稀疏点云中的挑战,我们提出了一种3D体素生成策略,利用线性分组RNN作为自回归模型的天然属性来稠密化前景特征。大量实验验证了所提组件的有效性以及LION在不同线性分组RNN算子(包括Mamba、RWKV和RetNet)上的泛化能力。此外,值得一提的是,我们的LION-Mamba在Waymo、nuScenes、Argoverse V2和ONCE数据集上取得了最先进的性能。最后,我们的方法在小巧但受欢迎的KITTI数据集上支持多种高级线性RNN算子(例如RetNet、RWKV、Mamba、xLSTM和TTT),以便快速体验我们基于线性RNN的框架。

英文摘要:

The benefit of transformers in large-scale 3D point cloud perception tasks, such as 3D object detection, is limited by their quadratic computation cost when modeling long-range relationships. In contrast, linear RNNs have low computational complexity and are suitable for long-range modeling. Toward this goal, we propose a simple and effective window-based framework built on LInear grOup RNN (i.e., perform linear RNN for grouped features) for accurate 3D object detection, called LION. The key property is to allow sufficient feature interaction in a much larger group than transformer-based methods. However, effectively applying linear group RNN to 3D object detection in highly sparse point clouds is not trivial due to its limitation in handling spatial modeling. To tackle this problem, we simply introduce a 3D spatial feature descriptor and integrate it into the linear group RNN operators to enhance their spatial features rather than blindly increasing the number of scanning orders for voxel features. To further address the challenge in highly sparse point clouds, we propose a 3D voxel generation strategy to densify foreground features thanks to linear group RNN as a natural property of auto-regressive models. Extensive experiments verify the effectiveness of the proposed components and the generalization of our LION on different linear group RNN operators including Mamba, RWKV, and RetNet. Furthermore, it is worth mentioning that our LION-Mamba achieves state-of-the-art on Waymo, nuScenes, Argoverse V2, and ONCE dataset. Last but not least, our method supports kinds of advanced linear RNN operators (e.g., RetNet, RWKV, Mamba, xLSTM and TTT) on small but popular KITTI dataset for a quick experience with our linear RNN-based framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑