arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.01899cs.CVcs.AI
收藏

FASTer:用于长期3D目标检测的焦点Token获取与缩放Transformer

FASTer: Focal Token Acquiring-and-Scaling Transformer for Long-term 3D Object Detection

Huazhong University of Science and Technology(华中科技大学)

Chenxu Dang, Zaipeng Duan, Pei An, Xinmin Zhang, Xuzhong Hu, Jie Ma

AI总结:

针对时序3D检测中无差别采样导致复杂度激增的问题,提出FASTer模型,通过自适应缩放机制动态选择焦点Token,并利用分组分层融合策略高效交换时空信息,在Waymo数据集上实现了性能与效率的双重提升。

摘要:

近期基于激光雷达的高性能时序3D检测器越来越多地采用基于区域的范式。它们首先生成粗略的提议,随后对区域特征进行编码与融合。然而,无差别的采样与融合往往忽略了各个点不同的贡献,并随着输入帧数的增加导致复杂度呈指数级增长。此外,任意的结构级拼接限制了全局信息的提取。在本文中,我们提出了一种焦点Token获取与缩放Transformer(FASTer),它以自适应且轻量级的方式动态选择焦点Token并精简Token序列。为强调各个Token的贡献,我们提出了一种简单但有效的自适应缩放机制,以在筛选焦点点的同时捕获几何上下文。自适应地仅存储和处理历史帧中的焦点点,极大地降低了整体复杂度。此外,提出了一种新颖的分组分层融合策略,逐步执行序列缩放和组内融合操作,以促进全局时空信息的交换。在Waymo Open Dataset上的实验表明,我们的FASTer在性能和效率上均显著优于其他最先进的检测器,同时展现出更好的灵活性和鲁棒性。代码可在 https://github.com/MSunDYY/FASTer.git 获取。

英文摘要:

Recent top-performing temporal 3D detectors based on Lidars have increasingly adopted region-based paradigms. They first generate coarse proposals, followed by encoding and fusing regional features. However, indiscriminate sampling and fusion often overlook the varying contributions of individual points and lead to exponentially increased complexity as the number of input frames grows. Moreover, arbitrary result-level concatenation limits the global information extraction. In this paper, we propose a Focal Token Acquring-and-Scaling Transformer (FASTer), which dynamically selects focal tokens and condenses token sequences in an adaptive and lightweight manner. Emphasizing the contribution of individual tokens, we propose a simple but effective Adaptive Scaling mechanism to capture geometric contexts while sifting out focal points. Adaptively storing and processing only focal points in historical frames dramatically reduces the overall complexity. Furthermore, a novel Grouped Hierarchical Fusion strategy is proposed, progressively performing sequence scaling and Intra-Group Fusion operations to facilitate the exchange of global spatial and temporal information. Experiments on the Waymo Open Dataset demonstrate that our FASTer significantly outperforms other state-of-the-art detectors in both performance and efficiency while also exhibiting improved flexibility and robustness. The code is available at https://github.com/MSunDYY/FASTer.git.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑