arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2408.11567cs.CV
收藏

位置提示微调用于高效3D表示学习

Positional Prompt Tuning for Efficient 3D Representation Learning

Xi'an Jiaotong University(西安交通大学);Tsinghua University(清华大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Shaochen Zhang, Zekun Qi, Runpei Dong, Xiuxiu Bai, Xing Wei

AI总结:

本文提出PPT方法,通过增加补丁令牌和可训练位置编码进行参数高效微调,仅用1.05M参数在多个3D点云数据集上取得最先进结果。

摘要:

我们重新思考位置编码在3D表示学习和微调中的作用。我们认为,在基于点Transformer的方法中使用位置编码是为了聚合点云的多尺度特征。此外,我们通过提示和适配器的视角探索参数高效微调(PEFT),引入了一种简单而有效的方法,称为PPT,用于点云分析。PPT增加了更多的补丁令牌和可训练的位置编码,同时保持大多数预训练模型参数冻结。大量实验验证了PPT既有效又高效。我们提出的PEFT任务方法,即PPT,仅需训练1.05M参数,就在几个主流数据集上取得了最先进的结果,例如在ScanObjectNN OBJ_BG数据集上达到95.01%的准确率。代码和权重将在https://github.com/zsc000722/PPT发布。

英文摘要:

We rethink the role of positional encoding in 3D representation learning and fine-tuning. We argue that using positional encoding in point Transformer-based methods serves to aggregate multi-scale features of point clouds. Additionally, we explore parameter-efficient fine-tuning (PEFT) through the lens of prompts and adapters, introducing a straightforward yet effective method called PPT for point cloud analysis. PPT incorporates increased patch tokens and trainable positional encoding while keeping most pre-trained model parameters frozen. Extensive experiments validate that PPT is both effective and efficient. Our proposed method of PEFT tasks, namely PPT, with only 1.05M of parameters for training, gets state-of-the-art results in several mainstream datasets, such as 95.01% accuracy in the ScanObjectNN OBJ_BG dataset. Codes and weights will be released at https://github.com/zsc000722/PPT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑