arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.18924cs.CV
收藏

LLM引导的分类体系与层次不确定性用于三维点云主动学习

LLM-Guided Taxonomy and Hierarchical Uncertainty for 3D Point Cloud Active Learning

Southwest Jiaotong University(西南交通大学)

Chenxi Li, Nuo Chen, Fengyun Tan, Yantong Chen, Bochun Yuan, Tianrui Li, Chongshou Li

AI总结:

本文首次将大型语言模型引入三维点云主动学习,通过LLM构建层次语义分类体系并递归传播不确定性,在极低标注预算下实现显著分割性能提升。

摘要:

我们提出了一种新颖的三维点云语义分割主动学习框架,该框架首次整合大型语言模型(LLMs)来构建层次化标签结构,并引导基于不确定性的样本选择。与以往将标签视为扁平且相互独立的方法不同,我们的方法利用LLM提示自动生成多层语义分类体系,并引入一种递归不确定性投影机制,在层次结构各层级之间传播不确定性。这使得空间多样、标签感知的点选择能够尊重三维场景固有的语义结构。在S3DIS和ScanNet v2上的实验表明,在极低标注预算(例如0.02%)下,我们的方法实现了最高4%的mIoU提升,显著优于现有基线。我们的结果凸显了LLM作为三维视觉中知识先验的未开发潜力,并将层次不确定性建模确立为高效点云标注的强大范式。

英文摘要:

We present a novel active learning framework for 3D point cloud semantic segmentation that, for the first time, integrates large language models (LLMs) to construct hierarchical label structures and guide uncertainty-based sample selection. Unlike prior methods that treat labels as flat and independent, our approach leverages LLM prompting to automatically generate multi-level semantic taxonomies and introduces a recursive uncertainty projection mechanism that propagates uncertainty across hierarchy levels. This enables spatially diverse, label-aware point selection that respects the inherent semantic structure of 3D scenes. Experiments on S3DIS and ScanNet v2 show that our method achieves up to 4% mIoU improvement under extremely low annotation budgets (e.g., 0.02%), substantially outperforming existing baselines. Our results highlight the untapped potential of LLMs as knowledge priors in 3D vision and establish hierarchical uncertainty modeling as a powerful paradigm for efficient point cloud annotation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑