arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.16500cs.CL
收藏

通过结构进化优化软提示微调

Optimizing Soft Prompt Tuning via Structural Evolution

School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);College of Professional and Continuing Education, The Hong Kong Polytechnic University(香港理工大学专业及继续教育学院);School of Robotics and Advanced Manufacture, Harbin Institute of Technology(哈尔滨工业大学机器人与先进制造学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院)

Zhenzhen Huang, Chaoning Zhang, Haoyu Bian, Songbo Zhang, Chi-lok Andy Tai, Jiaquan Zhang, Caiyan Qin, Jingjing Qu, Yalan Ye, Yang Yang, Heng Tao Shen

AI总结:

本文提出基于拓扑形态演化的软提示微调优化方法,通过拓扑持久同调量化结构表示,改进模型收敛速度和微调性能,提升可解释性。

摘要:

软提示微调利用连续嵌入来捕捉大预训练语言模型(LLMs)中的任务特定信息,在少样本设置中实现了具有竞争力的性能。然而,软提示依赖于高维隐式表示,缺乏显式语义和可追溯的训练行为,这限制了其可解释性。为了解决这一限制,我们提出了一种基于拓扑形态演化的软提示微调优化方法。具体来说,我们利用拓扑数据分析(TDA)中的持久同调来量化软提示在连续参数空间中的结构表示及其训练过程的演变。定量分析显示,拓扑稳定且紧凑的软提示在下游任务中表现更好。基于这一经验观察,我们构建了一个用于优化软提示微调的损失函数,称为拓扑软提示损失(TSLoss)。TSLoss通过量化参数间连接性和冗余性,指导模型学习结构稳定的适应。广泛实验表明,使用TSLoss训练可以加速收敛并提高微调性能,提供了一种可解释的方法来从结构和拓扑角度理解和优化软提示微调。

英文摘要:

Soft prompt tuning leverages continuous embeddings to capture task-specific information in large pre-trained language models (LLMs), achieving competitive performance in few-shot settings. However, soft prompts rely on high-dimensional, implicit representations and lack explicit semantics and traceable training behaviors, which limits their interpretability. To address this limitation, we propose a soft prompt tuning optimization method based on topological morphological evolution. Specifically, we employ persistent homology from topological data analysis (TDA) to quantify the structural representations of soft prompts in continuous parameter space and their training process evolution. Quantitative analysis shows that topologically stable and compact soft prompts achieve better downstream performance. Based on this empirical observation, we construct a loss function for optimizing soft prompt tuning, termed Topological Soft Prompt Loss (TSLoss). TSLoss guides the model to learn structurally stable adaptations by quantifying inter-parameter connectivity and redundancy. Extensive experiments show that training with TSLoss accelerates convergence and improves tuning performance, providing an interpretable method to understand and optimize soft prompt tuning from structural and topological perspectives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑