arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.04668cs.CL
收藏

零标签提示选择

Zero-Label Prompt Selection

Tsinghua University(清华大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Qizhi Institute(上海期智研究院)

Chonghua Liao, Yanan Zheng, Zhilin Yang

摘要:

自然语言提示已被证明有助于大语言模型的跨任务泛化。然而,没有或有限的标记的例子,跨任务的性能是高度敏感的提示的选择,而选择一个高性能的提示是具有挑战性的标签稀缺。为了解决这个问题,我们提出了一个零标签提示选择(ZPS)方法,选择提示没有任何标记的数据或梯度更新。具体来说,给定任务的候选人类书面提示,ZPS用提示集合标记一组未标记的数据,并使用伪标签进行提示选择。实验表明,ZPS在零标签性能上比以前的方法有相当大的提高。我们还将ZPS扩展到Few-Shot设置,并显示其优于强基线,如提示微调和模型调整。

英文摘要:

Natural language prompts have been shown to facilitate cross-task generalization for large language models. However, with no or limited labeled examples, the cross-task performance is highly sensitive to the choice of prompts, while selecting a high-performing prompt is challenging given the scarcity of labels. To address the issue, we propose a Zero-Label Prompt Selection (ZPS) method that selects prompts without any labeled data or gradient update. Specifically, given the candidate human-written prompts for a task, ZPS labels a set of unlabeled data with a prompt ensemble and uses the pseudo-labels for prompt selection. Experiments show that ZPS improves over prior methods by a sizeable margin in zero-label performance. We also extend ZPS to a few-shot setting and show its advantages over strong baselines such as prompt tuning and model tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑