arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09425cs.CVcs.LG
收藏

弥合道路激光雷达的模态差距:一种无需训练的视觉-语言模型框架用于车辆分类

Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification

Department of Civil Engineering, City College of New York(城市学院土木工程系);Department of Computer Science, City College of New York(城市学院计算机科学系)

Yiqiao Li, Bo Shang, Jie Wei

AI总结:

本文提出一种无需训练的视觉-语言模型框架,用于解决道路激光雷达中稀疏点云与密集图像之间的模态差距问题,实现细粒度车辆分类。

摘要:

细粒度卡车分类对于智能交通系统(ITS)至关重要,但目前基于激光雷达的方法由于依赖于监督深度学习和劳动密集型的手动标注而面临可扩展性挑战。视觉-语言模型(VLMs)提供了有希望的少样本泛化能力,但其应用于道路激光雷达受限于稀疏3D点云与密集2D图像之间的模态差距。我们提出了一种框架,通过适应现成的VLMs进行细粒度卡车分类,而无需参数微调。我们的新深度感知图像生成管道应用噪声去除、空间和时间配准、方向校正、形态学操作和各向异性平滑,将稀疏、遮挡的激光雷达扫描转换为深度编码的2D视觉代理。在包含20个车辆类别的真实世界数据集上验证,我们的方法在每个类别仅使用16-30个示例时即可实现竞争性的分类准确率,提供了一种比数据密集型监督基线更具可扩展性的替代方案。我们进一步观察到一种

英文摘要:

Fine-grained truck classification is critical for intelligent transportation systems (ITS), yet current LiDAR-based methods face scalability challenges due to their reliance on supervised deep learning and labor-intensive manual annotation. Vision-Language Models (VLMs) offer promising few-shot generalization, but their application to roadside LiDAR is limited by a modality gap between sparse 3D point clouds and dense 2D imagery. We propose a framework that bridges this gap by adapting off-the-shelf VLMs for fine-grained truck classification without parameter fine-tuning. Our new depth-aware image generation pipeline applies noise removal, spatial and temporal registration, orientation rectification, morphological operations, and anisotropic smoothing to transform sparse, occluded LiDAR scans into depth-encoded 2D visual proxies. Validated on a real-world dataset of 20 vehicle classes, our approach achieves competitive classification accuracy with as few as 16-30 examples per class, offering a scalable alternative to data-intensive supervised baselines. We further observe a "Semantic Anchor" effect: text-based guidance regularizes performance in ultra-low-shot regimes $k < 4$, but degrades accuracy in more-shot settings due to semantic mismatch. Furthermore, we demonstrate the efficacy of this framework as a Cold Start strategy, using VLM-generated labels to bootstrap lightweight supervised models. Notably, the few-shot VLM-based model achieves over correct classification rate of 75 percent for specific drayage categories (20ft, 40ft, and 53ft containers) entirely without the costly training or fine-tuning, significantly reducing the intensive demands of initial manual labeling, thus achieving a method of practical use in ITS applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑