arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.14845cs.LGcs.CL
收藏

提示未知:理解大语言模型中的响应不确定性

Prompting the Unknown: Understanding Response Uncertainty in Large Language Models

Alibaba Group(阿里巴巴集团);Harvard University(哈佛大学);National University of Singapore(新加坡国立大学)

Ze Yu Zhang, Arun Verma, Finale Doshi-Velez, Bryan Kian Hsiang Low

AI总结:

该研究针对大语言模型响应不确定性与提示的关系问题,提出含四类不确定性来源的提示-响应概念模型,经实验验证模型及相关理论结果。

摘要:

大语言模型(LLMs)被广泛应用于不同领域的决策中,确保生成安全可靠的响应对基于LLM的应用的有效部署至关重要,尤其是在医疗、金融等高风险领域。这些应用大多使用精心设计的提示来指导响应生成,但提示与LLM生成响应的可靠性之间的关系尚未完全明晰。为填补这一空白,我们提出一种新颖的提示-响应概念模型,通过识别响应不确定性的四个来源(提示欠规范、模型质量、任务变异性和语义冗余),解释提示中提供的任务相关信息量(信息量)与LLM生成响应不确定性之间的关系。我们证明,随着提示信息量或模型质量的提升,响应不确定性会降低,这与概率模型中的认知不确定性表现一致。我们在真实世界数据集上的实验结果进一步验证了所提出的模型,并证实了理论结果。

英文摘要:

Large language models (LLMs) are widely used in decision-making across diverse domains. Ensuring the generation of safe and reliable responses is critical for the effective deployment of LLM-based applications, particularly in high-stakes domains such as healthcare and finance. Most of these applications typically use carefully crafted prompts to guide response generation; however, the relationship between prompts and the reliability of LLM-generated responses is not yet fully understood. To address this gap, we propose a novel prompt-response concept model that explains the relationship between the amount of task-relevant information (informativeness) provided in the prompt and the LLM-generated response uncertainty by identifying four sources of response uncertainty: prompt underspecification, model quality, task variability, and semantic redundancy. We prove that response uncertainty decreases as prompt informativeness or model quality increases, mirroring the behavior of epistemic uncertainty in probabilistic models. Our experimental results on real-world datasets further validate our proposed model and corroborate the theoretical results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑