面向可行驶区域检测的任务导向预训练
Task-Oriented Pre-Training for Drivable Area Detection
AI总结:
本文提出任务导向预训练方法,利用SAM生成分割候选并结合SCEF微调CLIP筛选可行驶区域相关候选,在KITTI road数据集上取得优于传统预训练和自训练方法的性能。
摘要:
预训练技术在深度学习中发挥着至关重要的作用,能够提升模型在多种任务上的性能。通过先在大规模数据集上训练、再在任务特定数据上进行微调,预训练为模型奠定了坚实基础,提高了泛化能力并加快了收敛速度。这一方法在自然语言处理和计算机视觉领域取得了显著成功。然而,传统预训练方法需要大规模数据集和大量计算资源,并且只能通过长时间训练学习共享特征,难以捕获更深层的、任务特定的特征。本文提出一种任务导向的预训练方法,首先利用Segment Anything(SAM)模型生成冗余的分割候选区域。随后,我们引入一种特定类别增强微调(Specific Category Enhancement Fine-tuning,SCEF)策略,对Contrastive Language-Image Pre-training(CLIP)模型进行微调,以从SAM生成的候选区域中筛选出与可行驶区域最相关的候选。该方法能够为预训练模型生成大量粗略训练数据,这些模型再通过人工标注数据进行进一步微调,从而提升模型性能。在KITTI road数据集上进行的综合实验表明,与未经过预训练的模型相比,我们的任务导向预训练方法实现了全面的性能提升。此外,我们的预训练方法不仅超越了传统预训练方法,而且与最先进的自训练方法相比也取得了最佳性能。
英文摘要:
Pre-training techniques play a crucial role in deep learning, enhancing models' performance across a variety of tasks. By initially training on large datasets and subsequently fine-tuning on task-specific data, pre-training provides a solid foundation for models, improving generalization abilities and accelerating convergence rates. This approach has seen significant success in the fields of natural language processing and computer vision. However, traditional pre-training methods necessitate large datasets and substantial computational resources, and they can only learn shared features through prolonged training and struggle to capture deeper, task-specific features. In this paper, we propose a task-oriented pre-training method that begins with generating redundant segmentation proposals using the Segment Anything (SAM) model. We then introduce a Specific Category Enhancement Fine-tuning (SCEF) strategy for fine-tuning the Contrastive Language-Image Pre-training (CLIP) model to select proposals most closely related to the drivable area from those generated by SAM. This approach can generate a lot of coarse training data for pre-training models, which are further fine-tuned using manually annotated data, thereby improving model's performance. Comprehensive experiments conducted on the KITTI road dataset demonstrate that our task-oriented pre-training method achieves an all-around performance improvement compared to models without pre-training. Moreover, our pre-training method not only surpasses traditional pre-training approach but also achieves the best performance compared to state-of-the-art self-training methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。