arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04232cs.AIcs.CL
收藏

生成式智能体能否预测情绪?

Can Generative Agents Predict Emotion?

Grad. School of Science and Technology(科学技术研究生院);University of Tsukuba(筑波大学);Grad. School of Letters(文学院);Tokai University(东海大学)

Ciaran Regan, Nanami Iwahashi, Shogo Tanaka, Mizuki Oka

AI总结:

本研究提出一种通过比较新体验与过去记忆的规范来生成情境的架构,利用PANAS量表评估生成式LLM智能体的情绪状态,实验显示引入情境可部分改善情绪对齐。

摘要:

大型语言模型(LLMs)已展现出许多类人能力,然而LLMs的共情理解和情绪状态尚未与人类对齐。在本工作中,我们研究了生成式LLM智能体的情绪状态如何随着其感知新事件而演变,提出了一种新颖的架构,在该架构中,新体验会与过去的记忆进行比较。通过这种比较,智能体能够获得在情境中理解新体验的能力,根据情绪的评价理论,这对于情绪的产生至关重要。首先,智能体将新体验感知为时间序列文本数据。在感知每个新输入后,智能体会生成对过去相关记忆的摘要,称为“规范”,并将新体验与此规范进行比较。通过这种比较,我们可以分析智能体在情境中对新体验的反应。对智能体施测PANAS(积极和消极情感量表),以捕捉其感知新事件后的情绪状态。最后,新体验被添加到智能体的记忆中,用于生成未来的规范。通过从情绪化情境中创建多种自然语言体验,我们在广泛场景下测试了所提出的架构。混合结果表明,引入情境有时可以改善智能体的情绪对齐,但仍需进一步研究并与人类评估者进行比较。我们希望本文能成为生成式智能体对齐的又一步。

英文摘要:

Large Language Models (LLMs) have demonstrated a number of human-like abilities, however the empathic understanding and emotional state of LLMs is yet to be aligned to that of humans. In this work, we investigate how the emotional state of generative LLM agents evolves as they perceive new events, introducing a novel architecture in which new experiences are compared to past memories. Through this comparison, the agent gains the ability to understand new experiences in context, which according to the appraisal theory of emotion is vital in emotion creation. First, the agent perceives new experiences as time series text data. After perceiving each new input, the agent generates a summary of past relevant memories, referred to as the norm, and compares the new experience to this norm. Through this comparison we can analyse how the agent reacts to the new experience in context. The PANAS, a test of affect, is administered to the agent, capturing the emotional state of the agent after the perception of the new event. Finally, the new experience is then added to the agents memory to be used in the creation of future norms. By creating multiple experiences in natural language from emotionally charged situations, we test the proposed architecture on a wide range of scenarios. The mixed results suggests that introducing context can occasionally improve the emotional alignment of the agent, but further study and comparison with human evaluators is necessary. We hope that this paper is another step towards the alignment of generative agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑