arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.13490cs.CL
收藏

约束推理链增强大型语言模型中的心智理论

Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Models

HKUST(香港科技大学);Amazon(亚马逊)

Zizheng Lin, Chunkit Chan, Yangqiu Song, Xin Liu

AI总结:

提出零样本提示方法CCoToM,利用领域知识和ToM维度间因果关系,通过构建显式推理链并施加约束,提升LLMs在复杂及非叙事场景下的心智理论推理能力,大幅超越现有方法。

摘要:

大型语言模型(LLMs)所具备的心智理论(ToM)能力已被证明是有限的。现有的大多数提升LLMs中ToM的方法采用零样本提示,它们面临挑战,包括在复杂ToM推理任务中性能不佳以及无法处理非叙事性上下文。我们提出了一种名为约束Chain-of-ToM(CCoToM)的零样本提示方法,该方法利用领域知识和ToM维度之间的因果关系来解决这些局限性。具体来说,CCoToM通过首先提示LLMs推断相关的ToM维度(例如,信念),引导LLMs构建显式推理链。之后,CCoToM基于生成的相关ToM维度和相应的因果关系,提示LLMs推断查询的ToM维度。此外,CCoToM自适应地对提示施加约束,以引入归纳偏差并提高ToM维度之间的一致性。除了叙事,CCoToM还可以处理非叙事性上下文,如对话。大量实验表明,CCoToM在所有使用的LLMs和数据集上均大幅优于先前的最先进方法。我们还进行了深入分析,以更深入地了解CCoToM。我们已公开我们的代码。

英文摘要:

Theory-of-Mind (ToM) ability possessed by Large Language Models (LLMs) has been shown to be limited. Most existing methods for improving ToM in LLMs adopt zero-shot prompting, and they face challenges including poor performance in complex ToM reasoning tasks and an inability to handle non-narrative contexts. We propose a zero-shot prompting method named Constrained Chain-of-ToM (CCoToM) that leverages domain knowledge and the causal relations between ToM dimensions to address these limitations. Specifically, CCoToM guides LLMs to construct explicit reasoning chains by first prompting LLMs to infer related ToM dimensions (e.g., belief). Afterward, CCoToM prompts LLMs to infer the queried ToM dimension based on the generated related ToM dimensions and corresponding causal relations. Additionally, CCoToM adaptively imposes constraints on prompts to introduce inductive biases and improve consistency between ToM dimensions. Besides narratives, CCoToM can also handle non-narrative contexts like conversations. Extensive experiments show that CCoToM consistently outperforms previous state-of-the-art methods by large margins across all LLMs and datasets used. We also conduct in-depth analyses to gain deeper insights into CCoToM. We have made our code publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑