arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2602.01637cs.LG
收藏

针对大语言模型幻觉风险的置信约束推断

Chance-Constrained Inference for Hallucination Risk Control in Large Language Models

International Institute of Information Technology, Hyderabad, India(国际信息科技研究所,海得拉巴,印度)

Sreenivasan Mohandas

AI总结:

本研究提出置信约束推断方法,通过限制幻觉发生的概率,实现大语言模型在部署时的风险控制,实验显示其在风险控制、输入检测和重复使用中的有效性。

摘要:

大语言模型生成输出具有随机性,可能会产生流畅但无效的响应,包括事实性幻觉。现有的缓解策略减少了平均错误率,但不能在重复使用时提供对这类失败频率的显式控制。我们将推断视为部署时的风险控制问题,并引入置信约束推断,直接限制接受生成中幻觉发生的概率。幻觉被建模为随机约束违反,我们证明基于置信度的选择性预测通常不意味着概率风险保证。为了高效地执行置信约束,我们提出了一种顺序、随时有效的推断过程,利用有限样本自适应地验证可行性或不可行性,避免保守的固定样本界限。在受NaturalQuestions启发的问题和受控多跳问答任务上的实验表明,能够可靠地控制风险,早期检测本质上不可行的输入,并在重复使用时安全组合,而基于置信度的基线方法无法提供一致保证。

英文摘要:

Large language models generate outputs stochastically and may produce fluent but invalid responses, including factual hallucinations. Existing mitigation strategies reduce average error rates but do not provide explicit control over the \emph{frequency} of such failures under repeated use. We formulate inference as a deployment-time risk control problem and introduce \emph{chance-constrained inference}, which directly bounds the probability of hallucinations among accepted generations. Hallucinations are modeled as stochastic constraint violations, and we show that confidence-based selective prediction does not, in general, imply probabilistic risk guarantees. To enforce chance constraints efficiently, we propose a sequential, anytime-valid inference procedure that adaptively certifies feasibility or infeasibility using finite samples, avoiding conservative fixed-sample bounds. Experiments on questions inspired by NaturalQuestions and controlled multi-hop question answering demonstrate reliable risk control, early detection of intrinsically infeasible inputs, and safe composition under repeated use, while confidence-based baselines fail to provide consistent guarantees.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑