Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfer
Faculty of Information Technology, Brno University of Technology(布拉格技术大学信息学院);Kempelen Institute of Intelligent Technologies(智能技术研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
Robert Belanec, Simon Ostermann, Ivan Srba, Maria Bielikova
Prompt tuning is an efficient solution for training large language models (LLMs). However, current soft-prompt-based methods often sacrifice multi-task modularity, requiring the training process to be fully or partially repeated for each newly added task. While recent work on task vectors applied arithmetic operations on full model weights to achieve the desired multi-task performance, a similar approach for soft-prompts is still missing. To this end, we introduce Task Prompt Vectors, created by element-wise difference between weights of tuned soft-prompts and their random initialization. Experimental results on 12 NLU datasets show that task prompt vectors can be used in low-resource settings to effectively initialize prompt tuning on similar tasks. In addition, we show that task prompt vectors are independent of the random initialization of prompt tuning on 2 different language model architectures. This allows prompt arithmetics with the pre-trained vectors from different tasks. In this way, we provide a competitive alternative to state-of-the-art baselines by arithmetic addition of task prompt vectors from multiple tasks.
Optimizing Soft Prompt Tuning via Structural Evolution
School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);College of Professional and Continuing Education, The Hong Kong Polytechnic University(香港理工大学专业及继续教育学院);School of Robotics and Advanced Manufacture, Harbin Institute of Technology(哈尔滨工业大学机器人与先进制造学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院)
University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);Institute of Dataspace(天空间研究院);AtomEcho Inc.(AtomEcho公司);Academy of Cyber(网络研究院)
Improving Complex Reasoning with Dynamic Prompt Corruption: A soft prompt Optimization Approach
Zhejiang University(浙江大学);Hangzhou YunQi Academy of Engineering(杭州云栖工程学院);College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);Alibaba Cloud Computing(阿里巴巴云计算)
PromptEmbedder: Efficient and Transferable Text Embedding via Dual-LLM Soft Prompting
Department of Computer Science and Information Engineering, National Taiwan University(国立台湾大学计算机科学与资讯工程系);National Taiwan University AI Center of Research Excellence(国立台湾大学人工智能研究中心)
STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification
University of Chinese Academy of Sciences(中国科学院大学);Institute of Information Engineering(信息工程研究所);Beijing Institute of Technology(北京理工大学);Guangzhou University(广州大学)
Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning
School of Computer Science, Wuhan University(武汉大学计算机学院);National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);School of Electronic Information Engineering, Henan Polytechnic Institute(河南工业职业技术学院电子信息工程学院);JD Explore Academy(京东探索研究院)
Enhancing Low-Resource Relation Representations through Multi-View Decoupling
Cognitive Computing and Intelligent Information Processing (CCIIP) Laboratory, School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院认知计算与智能信息处理实验室);Joint Laboratory of HUST and Pingan Property & Casualty Research (HPL)(华中科技大学与平安财产保险联合实验室);Ping An Property & Casualty Insurance Company of China, Ltd.(中国平安财产保险股份有限公司);The Chinese University of Hong Kong(香港中文大学);Shanghai AI Laboratory(上海人工智能实验室)
Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting
Chalmers University of Technology and University of Gothenburg, Sweden(楚姆勒大学技术学院和哥德堡大学,瑞典);Technical University of Denmark, Kgs. Lyngby, Denmark(丹麦技术大学,基斯勒吕辛,丹麦)
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting
George Mason University(乔治梅森大学);GE Healthcare(GE医疗);University of Pittsburgh(匹兹堡大学);William and Mary(威廉玛丽学院);Southern University of Science and Technology(南方科技大学);Florida State University(佛罗里达州立大学)
Faculty of Information Technology, Brno University of Technology(布拉格技术大学信息学院);Kempelen Institute of Intelligent Technologies(智能技术研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)