你说了什么,还是你怎么说?预测真实对话与 LLM 生成对话中的冲突结果
What you say or how you say it? Predicting Conflict Outcomes in Real and LLM-Generated Conversations
AI总结:
本文结合内容与表达特征,分析 GPT-4 模拟对话和 Reddit 真实讨论,发现表达特征更能预测破坏性冲突结果,但关键动态特征在两类对话中不同,揭示 LLM 模拟社会互动的局限。
摘要:
当冲突升级时,它是由所说的内容导致的,还是由表达方式导致的?在冲突研究文献中,两种理论路径持相反观点:一种关注分歧的内容,另一种则关注分歧如何被表达。本文旨在通过对 191 个沟通特征进行计算分析来整合这两种视角,其中 128 个特征与表达有关,63 个特征与内容有关。我们分析了 1,200 段 GPT-4 模拟对话以及来自 Reddit 的 12,630 场真实世界讨论。我们发现,在两种情境中,表达特征都能更可靠地预测破坏性冲突结果,尽管最重要的特征有所不同。在 Reddit 数据中,话轮转换和对话平等性等对话动态具有很高的预测力,但它们在模拟对话中并不具备预测力。这些结果可能表明,使用语言模型模拟社会互动存在一种可能的局限;我们还讨论了研究发现对于构建社会计算系统的意义。
英文摘要:
When conflicts escalate, is it due to what is said or how it is said? In the conflict literature, two theoretical approaches take opposing views: one focuses on the content of the disagreement, while the other focuses on how it is expressed. This paper aims to integrate these two perspectives through a computational analysis of 191 communication features -- 128 related to expression and 63 to content. We analyze 1,200 GPT-4 simulated conversations and 12,630 real-world discussions from Reddit. We find that expression features more reliably predict destructive conflict outcomes across both settings, although the most important features differ. In the Reddit data, conversational dynamics such as turn-taking and conversational equality are highly predictive, but they are not predictive in simulated conversations. These results may suggest a possible limitation in simulating social interactions with language models, and we discuss the implications for our findings on building social computing systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。