arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.04064cs.AI
收藏

解码深层情感:关于LLM如何表征、保留与表达情感的系统性研究

Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotion

Jingxiang Zhang, Lujia Zhong

AI总结:

本文通过引入约40万条话语的Reddit情感语料库,利用轻量级探针研究Qwen3和LLaMA模型内部情感表征,发现情感几何结构随模型规模增强且优于零样本提示,情感信号早期出现并达峰值,且具可塑性与持久性,贡献了数据集、工具包及情感图谱。

摘要:

大型语言模型(LLMs)越来越被期望能够驾驭人类情感的细微差别。虽然研究确认LLMs可以模拟情感智能,但其内部情感机制在很大程度上仍未被探索。本文通过提出以下问题来研究现代LLMs内部的潜在情感表征:情感在其神经架构中是如何、在哪里以及被编码多长时间?为了解决这个问题,我们引入了一个新的大规模Reddit语料库,包含约400,000条话语,通过分类、重写和合成生成的多阶段过程,在七种基本情感之间实现了平衡。使用该数据集,我们采用轻量级“探针”来读取各种Qwen3和LLaMA模型隐藏层中的信息,而无需改变其参数。我们的发现表明,LLMs发展出了一种令人惊讶的、定义明确的内部情感几何结构,这种结构随着模型规模的扩大而变得更加清晰,并且显著优于零样本提示。我们证明,这种情感信号并非最终层现象,而是早期出现并在网络中层达到峰值。此外,内部状态既具有可塑性(它们可以受简单系统提示影响),又具有持久性,因为初始的情感基调在随后的数百个token中仍然可以被检测到。我们贡献了我们的数据集、一个开源探测工具包,以及LLMs内部情感景观的详细图谱,为开发更透明、更对齐的AI系统提供了关键见解。代码和数据集已开源。

英文摘要:

Large Language Models (LLMs) are increasingly expected to navigate the nuances of human emotion. While research confirms that LLMs can simulate emotional intelligence, their internal emotional mechanisms remain largely unexplored. This paper investigates the latent emotional representations within modern LLMs by asking: how, where, and for how long is emotion encoded in their neural architecture? To address this, we introduce a novel, large-scale Reddit corpus of approximately 400,000 utterances, balanced across seven basic emotions through a multi-stage process of classification, rewriting, and synthetic generation. Using this dataset, we employ lightweight "probes" to read out information from the hidden layers of various Qwen3 and LLaMA models without altering their parameters. Our findings reveal that LLMs develop a surprisingly well-defined internal geometry of emotion, which sharpens with model scale and significantly outperforms zero-shot prompting. We demonstrate that this emotional signal is not a final-layer phenomenon but emerges early and peaks mid-network. Furthermore, the internal states are both malleable (they can be influenced by simple system prompts) and persistent, as the initial emotional tone remains detectable for hundreds of subsequent tokens. We contribute our dataset, an open-source probing toolkit, and a detailed map of the emotional landscape within LLMs, offering crucial insights for developing more transparent and aligned AI systems. The code and dataset are open-sourced.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑