HEART-Bench: 大语言模型智能体是否表现出类似人类的心理学？
HEART-Bench: Do LLM Agents Exhibit Human-like Psychology?
AI总结：
提出HEART-Bench基准，通过构建基于大五人格和自传体记忆的虚拟角色，在DIAMONDS情境框架下评估LLM智能体能否展现一致的人类心理特征。
摘要：
尽管LLM智能体在规划、推理和行动等任务导向能力上表现出色，但很少有研究将它们视为完整的人类个性，其中情感维度同样重要。在本文中，我们引入了一个新颖的基准，系统评估LLM智能体是否能模拟连贯、类似人类的心理。具体来说，我们的基准构建了11个基于正交大五人格特质的多样化人类角色，每个角色都深入整合了1000个结构化的自传体式情景记忆，这些记忆分布在基于理论的发展生命阶段。为了严格评估LLM的心理表现，我们设计了一套由64个决策场景组成的精选套件，这些场景基于DIAMONDS分类法，这是一个心理框架，从八个维度描述情境：责任、智力、逆境、求偶、积极性、消极性、欺骗和社交性。通过将智能体置于不同场景中，基准评估它们是否能整合其固有的人格特质和自传体记忆，做出与其特定心理特征一致的行为决策。经过系统的人工验证和过滤，我们得到了一个包含673道多项选择题（MCQ）的基准。我们相信，这个基准为研究基于LLM的智能体中的人类情感、人格一致性和价值一致的行为决策提供了一个原则性且可扩展的测试平台。
英文摘要：
While LLM agents have demonstrated remarkable task-oriented abilities such as planning, reasoning, and action, few works have treated them as complete human personalities where emotional dimensions hold equal importance. In this paper, we introduce a novel benchmark to systematically assess whether LLM agents can simulate coherent, human-like psychology. Specifically, our benchmark constructs 11 diverse human characters grounded in orthogonal Big Five personality traits, with each profile deeply integrated with 1,000 structured autobiographical-style episodic memories distributed across theory-grounded developmental life stages. To rigorously evaluate the psychological manifestations of LLMs, we designed a curated suite of 64 decision-making scenarios, guided by the DIAMONDS taxonomy, a psychological framework that characterizes situations along eight dimensions: Duty, Intellect, Adversity, Mating, pOsitivity, Negativity, Deception, and Sociality. By subjecting agents to varying scenarios, the benchmark evaluates whether they can consolidate their innate personality traits and autobiographical memories to make behavioral decisions that are consistent with their specific psychological profiles. After systematic human validation and filtering, we obtained a benchmark consisting of 673 multiple-choice questions (MCQs). We believe this benchmark provides a principled and scalable testbed for studying human-like emotions, personality consistency, and value-consistent behavioural decision-making in LLM-based agents.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
