arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.01757cs.CV

PillarDETR:基于YOLO骨干和RT-DETR头的实时3D目标检测

PillarDETR: YOLO-Backbone and RT-DETR Head for Real-Time 3D Object Detection

University of California, Berkeley(加州大学伯克利分校)

Smit Kadvani, Shriya Gumber, Kriti Faujdar, Harsh Dave

AI总结:

提出PillarDETR架构,结合YOLOv8的CSP骨干和RT-DETR解码器,实现无需NMS的端到端实时3D目标检测,在KITTI和nuScenes上取得精度与速度的良好平衡。

摘要:

实时3D目标检测是自动驾驶系统和机器人安全运行的关键组成部分。虽然LiDAR点云提供准确的空间信息,但高效处理它们仍然是一个重大挑战。传统方法依赖于复杂的3D卷积或基于锚点的范式,难以平衡检测精度与推理速度。在本文中,我们提出PillarDETR,一种新颖的端到端3D目标检测架构,它将基于柱体的LiDAR编码的效率与现代2D视觉模型的表示能力相结合。具体来说,PillarDETR用源自YOLOv8的跨阶段局部(CSP)网络替代标准卷积骨干,从而能够从伪图像中提取更丰富的特征。此外,我们摒弃了传统的基于锚点或基于中心的检测头,转而采用实时检测Transformer(RT-DETR)解码器。这种混合设计使网络能够捕获全局上下文并直接预测3D边界框,而无需依赖非极大值抑制(NMS)。在KITTI和nuScenes基准上的大量实验表明,PillarDETR在平均精度(mAP)和推理延迟之间实现了令人信服的权衡。我们的消融研究证实,集成YOLOv8骨干和RT-DETR头相比PointPillars基线带来了显著改进,使PillarDETR成为实时3D感知的高效解决方案。

英文摘要:

Real-time 3D object detection is a critical component for the safe operation of autonomous driving systems and robotics. While LiDAR point clouds provide accurate spatial information, processing them efficiently remains a significant challenge. Traditional methods rely on complex 3D convolutions or anchor-based paradigms that struggle to balance detection accuracy with inference speed. In this paper, we propose PillarDETR, a novel end-to-end 3D object detection architecture that combines the efficiency of pillar-based LiDAR encoding with the representational power of modern 2D vision models. Specifically, PillarDETR replaces standard convolutional backbones with a Cross Stage Partial (CSP) network derived from YOLOv8, enabling richer feature extraction from pseudoimages. Furthermore, we discard conventional anchor-based or center-based detection heads in favor of a Real-Time Detection Transformer (RT-DETR) decoder. This hybrid design allows the network to capture global context and directly predict 3D bounding boxes without relying on non-maximum suppression (NMS). Extensive experiments on the KITTI and nuScenes benchmarks demonstrate that PillarDETR achieves a compelling trade-off between mean Average Precision (mAP) and inference latency. Our ablation studies confirm that integrating the YOLOv8 backbone and RT-DETR head yields substantial improvements over the PointPillars baseline, establishing PillarDETR as a highly effective solution for real-time 3D perception.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑