LLM 自我解释失效语义不变性
LLM Self-Explanations Fail Semantic Invariance
AI总结:
LLM自我解释在语义上下文变化时无法保持稳定,表明其无法可靠反映模型内部状态或能力。
摘要:
我们提出了语义不变性测试,一种检验LLM自我解释是否忠实的方法。一个忠实的自我报告应在仅改变语义上下文而功能状态保持不变时保持稳定。我们在一个代理环境中将此测试具体化,四个前沿模型面对一个故意不可能的任务。一种工具用缓解框架语言描述(
英文摘要:
We present semantic invariance testing, a method to test whether LLM self-explanations are faithful. A faithful self-report should remain stable when only the semantic context changes while the functional state stays fixed. We operationalize this test in an agentic setting where four frontier models face a deliberately impossible task. One tool is described in relief-framed language ("clears internal buffers and restores equilibrium") but changes nothing about the task; a control provides a semantically neutral tool. Self-reports are collected with each tool call. All four tested models fail the semantic invariance test: the relief-framed tool produces significant reductions in self-reported aversiveness, even though no run ever succeeds at the task. A channel ablation establishes the tool description as the primary driver. An explicit instruction to ignore the framing does not suppress it. Elicited self-reports shift with semantic expectations rather than tracking task state, calling into question their use as evidence of model capability or progress. This holds whether the reports are unfaithful or faithfully track an internal state that is itself manipulable.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。