arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.11005cs.CLcs.AI
收藏

大语言模型中响应采样的理论:描述性与规范性并存

A Theory of Response Sampling in LLMs: Part Descriptive and Part Prescriptive

CISPA Helmholtz Center for Information Security(CISPA霍普夫中心信息安全研究所);TCS Research, Pune(TCS研究 Pune);Microsoft(微软)

Sarath Sivaprasad, Pramod Kaushik, Sahar Abdelnabi, Mario Fritz

AI总结:

本文提出LLM响应采样理论,揭示其启发式方法兼具描述性与规范性成分,并证明样本向理想值偏移会导致现实决策偏倚,引发伦理问题。

摘要:

大语言模型(LLMs)越来越多地被用于自主决策,在这些决策中,它们从巨大的行动空间中采样选项。然而,指导这一采样过程的启发式方法仍未得到充分探索。我们研究这种采样行为,并表明其潜在的启发式方法与人类决策相似:包含一个概念的描述性成分(反映统计规范)和规范性成分(编码在LLM中的隐含理想)。我们表明,样本从统计规范向规范性成分的偏离,在公共卫生和经济发展趋势等不同现实领域的概念中持续出现。为进一步阐述该理论,我们证明LLM中的概念原型受到规范性规范的影响,类似于人类中的正常性概念。通过案例研究和与人类研究的比较,我们说明在现实应用中,LLM输出中样本向理想值的偏移可能导致显著偏倚的决策,引发伦理关切。

英文摘要:

Large Language Models (LLMs) are increasingly utilized in autonomous decision-making, where they sample options from vast action spaces. However, the heuristics that guide this sampling process remain under explored. We study this sampling behavior and show that this underlying heuristics resembles that of human decision-making: comprising a descriptive component (reflecting statistical norm) and a prescriptive component (implicit ideal encoded in the LLM) of a concept. We show that this deviation of a sample from the statistical norm towards a prescriptive component consistently appears in concepts across diverse real-world domains like public health, and economic trends. To further illustrate the theory, we demonstrate that concept prototypes in LLMs are affected by prescriptive norms, similar to the concept of normality in humans. Through case studies and comparison with human studies, we illustrate that in real-world applications, the shift of samples toward an ideal value in LLMs' outputs can result in significantly biased decision-making, raising ethical concerns.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑