Optimizing Soft Prompt Tuning via Structural Evolution
School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);College of Professional and Continuing Education, The Hong Kong Polytechnic University(香港理工大学专业及继续教育学院);School of Robotics and Advanced Manufacture, Harbin Institute of Technology(哈尔滨工业大学机器人与先进制造学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院)
Zhenzhen Huang, Chaoning Zhang, Haoyu Bian, Songbo Zhang, Chi-lok Andy Tai, Jiaquan Zhang, Caiyan Qin, Jingjing Qu, Yalan Ye, Yang Yang, Heng Tao Shen
备注:
This manuscript has been submitted to IEEE Transactions on Knowledge and Data Engineering (TKDE) for peer review
Soft prompt tuning leverages continuous embeddings to capture task-specific information in large pre-trained language models (LLMs), achieving competitive performance in few-shot settings. However, soft prompts rely on high-dimensional, implicit representations and lack explicit semantics and traceable training behaviors, which limits their interpretability. To address this limitation, we propose a soft prompt tuning optimization method based on topological morphological evolution. Specifically, we employ persistent homology from topological data analysis (TDA) to quantify the structural representations of soft prompts in continuous parameter space and their training process evolution. Quantitative analysis shows that topologically stable and compact soft prompts achieve better downstream performance. Based on this empirical observation, we construct a loss function for optimizing soft prompt tuning, termed Topological Soft Prompt Loss (TSLoss). TSLoss guides the model to learn structurally stable adaptations by quantifying inter-parameter connectivity and redundancy. Extensive experiments show that training with TSLoss accelerates convergence and improves tuning performance, providing an interpretable method to understand and optimize soft prompt tuning from structural and topological perspectives.
AutoMedPrompt: A New Framework for Optimizing LLM Medical Prompts Using Textual Gradients
Keck Data Science Institute, Pepperdine University(佩珀代因大学凯克数据科学研究所);Department of Medicine, University of California, Los Angeles(加利福尼亚大学洛杉矶分校医学院);Biological Sciences Division, University of Chicago(芝加哥大学生物科学部);Brain Research Institute, University of California, Los Angeles(加利福尼亚大学洛杉矶分校脑研究所)
Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfer
Faculty of Information Technology, Brno University of Technology(布拉格技术大学信息学院);Kempelen Institute of Intelligent Technologies(智能技术研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning
Carnegie Mellon University(卡内基梅隆大学);UC San Diego(加州大学圣地亚哥分校);MIT(麻省理工学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Petuum Inc.(Petuum公司)
Improving Complex Reasoning with Dynamic Prompt Corruption: A soft prompt Optimization Approach
Zhejiang University(浙江大学);Hangzhou YunQi Academy of Engineering(杭州云栖工程学院);College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);Alibaba Cloud Computing(阿里巴巴云计算)
PromptEmbedder: Efficient and Transferable Text Embedding via Dual-LLM Soft Prompting
Department of Computer Science and Information Engineering, National Taiwan University(国立台湾大学计算机科学与资讯工程系);National Taiwan University AI Center of Research Excellence(国立台湾大学人工智能研究中心)
SPRIG: Improving Large Language Model Performance by System Prompt Optimization
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Michigan(密歇根大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);LG AI Research(LG AI 研究院)
Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning
School of Computer Science, Wuhan University(武汉大学计算机学院);National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);School of Electronic Information Engineering, Henan Polytechnic Institute(河南工业职业技术学院电子信息工程学院);JD Explore Academy(京东探索研究院)
Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting
Chalmers University of Technology and University of Gothenburg, Sweden(楚姆勒大学技术学院和哥德堡大学,瑞典);Technical University of Denmark, Kgs. Lyngby, Denmark(丹麦技术大学,基斯勒吕辛,丹麦)