从意义出发映射:解决提示词敏感语言模型的校准不良问题
Mapping from Meaning: Addressing the Miscalibration of Prompt-Sensitive Language Models
AI总结:
该研究将提示词敏感性建模为泛化误差,通过语义释义扰动采样改善 LLM 不确定性校准,并提出分解指标以量化提示词敏感性导致的不确定性。
摘要:
大型语言模型(LLM)的一个有趣行为是提示词敏感性。当面对同一提示词的不同但语义等价的版本时,模型可能产生差异很大的答案分布。这表明,模型针对某一提示词的输出分布所反映的不确定性,可能并不能反映模型对该提示词意义的不确定性。我们将提示词敏感性建模为一种泛化误差,并证明通过释义扰动在语义“概念空间”中进行采样,可以在不损害准确率的情况下改善不确定性校准。此外,我们提出了一种用于黑盒 LLM 不确定性分解的新指标;该指标通过对自然语言生成中的语义连续性进行建模,改进了基于熵的分解方法。我们证明,该分解指标可用于量化 LLM 的不确定性中有多少可归因于提示词敏感性。本工作引入了一种改善提示词敏感语言模型不确定性校准的新方法,并提供证据表明,某些 LLM 无法围绕其输入的意义表现出一致的通用推理。
英文摘要:
An interesting behavior in large language models (LLMs) is prompt sensitivity. When provided with different but semantically equivalent versions of the same prompt, models may produce very different distributions of answers. This suggests that the uncertainty reflected in a model's output distribution for one prompt may not reflect the model's uncertainty about the meaning of the prompt. We model prompt sensitivity as a type of generalization error, and show that sampling across the semantic ``concept space'' with paraphrasing perturbations improves uncertainty calibration without compromising accuracy. Additionally, we introduce a new metric for uncertainty decomposition in black-box LLMs that improves upon entropy-based decomposition by modeling semantic continuities in natural language generation. We show that this decomposition metric can be used to quantify how much LLM uncertainty is attributed to prompt sensitivity. Our work introduces a new way to improve uncertainty calibration in prompt-sensitive language models, and provides evidence that some LLMs fail to exhibit consistent general reasoning about the meanings of their inputs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。