arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.01247cs.CL
收藏

基于语义的模型真的理解它们的语义吗?

Do Prompt-Based Models Really Understand the Meaning of their Prompts?

Brown University(布朗大学)

Albert Webson, Ellie Pavlick

摘要:

最近,大量的论文显示了各种基于学习模型的zero-shot和少样本学习的非凡进展。通常认为,提示有助于模型更快地学习,就像人类在获得以自然语言表达的任务指令时学习得更快一样。在这项研究中,我们实验了超过30个提示模板手动编写的自然语言推理(NLI)。我们发现,模型学习的速度与许多故意不相关甚至病态误导的提示一样快,因为它们具有明显的“好”提示。此外,这种模式甚至适用于大到1750亿个参数的模型(Brown等人,2020)以及最近提出的在数百个提示上训练的预防调整模型(Sanh等人,2022年)。也就是说,即使在零射击的情况下,谨慎调整的模型也经常产生良好的预测,而不相关和误导性的提示。总之,尽管基于任务的模型有了令人印象深刻的改进,但我们发现了严重的局限性,这些局限性质疑这种改进在多大程度上来自于模型以类似于人类使用任务指令的方式理解任务指令。

英文摘要:

Recently, a boom of papers has shown extraordinary progress in zero-shot and few-shot learning with various prompt-based models. It is commonly argued that prompts help models to learn faster in the same way that humans learn faster when provided with task instructions expressed in natural language. In this study, we experiment with over 30 prompt templates manually written for natural language inference (NLI). We find that models learn just as fast with many prompts that are intentionally irrelevant or even pathologically misleading as they do with instructively "good" prompts. Further, such patterns hold even for models as large as 175 billion parameters (Brown et al., 2020) as well as the recently proposed instruction-tuned models which are trained on hundreds of prompts (Sanh et al., 2022). That is, instruction-tuned models often produce good predictions with irrelevant and misleading prompts even at zero shots. In sum, notwithstanding prompt-based models' impressive improvement, we find evidence of serious limitations that question the degree to which such improvement is derived from models understanding task instructions in ways analogous to humans' use of task instructions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑