arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.08641cs.CLcs.AI

重新评估思维链在情感分析中的作用:洞见与局限

Reassessing the Role of Chain-of-Thought in Sentiment Analysis: Insights and Limitations

Beijing Normal University(北京师范大学);Hefei University(合肥大学);Beihang University(北京航空航天大学);University of Washington(华盛顿大学);University of Copenhagen(哥本哈根大学)

Kaiyuan Zheng, Qinghua Zhao, Lei Li

AI总结:

该研究以大语言模型为载体,将思维概念化为推理、采用chain-of-thought提示开展实验,探究语义理解是否依赖思维过程,发现思维链对情感分析影响极小,模型处理情感任务主要依赖示例信息,支持语言与思维独立的观点。

摘要:

语言与思维的关系仍是一个悬而未决的哲学问题,现有观点大致可分为两派:一派主张二者相互独立,另一派则认为语言约束思维。在大语言模型的语境下,这一争论引出了一个关键问题:语言模型对语义的掌握是否依赖于思维过程?为探究这一问题,我们研究了推理技术是否能够促进语义理解。具体而言,我们将思维概念化为推理,采用chain-of-thought(思维链)提示作为推理技术,考察其对情感分析任务的影响。实验表明,chain-of-thought对情感分析任务的影响极小。标准提示和chain-of-thought提示生成的内容都聚焦于方面词而非情感。此外,反事实实验显示,模型处理情感任务主要依赖于示例中的信息。实验结果支持第一种观点。

英文摘要:

The relationship between language and thought remains an unresolved philosophical issue. Existing viewpoints can be broadly categorized into two schools: one asserting their independence, and another arguing that language constrains thought. In the context of large language models, this debate raises a crucial question: Does a language model's grasp of semantic meaning depend on thought processes? To explore this issue, we investigate whether reasoning techniques can facilitate semantic understanding. Specifically, we conceptualize thought as reasoning, employ chain-of-thought prompting as a reasoning technique, and examine its impact on sentiment analysis tasks. The experiments show that chain-of-thought has a minimal impact on sentiment analysis tasks. Both the standard and chain-of-thought prompts focus on aspect terms rather than sentiment in the generated content. Furthermore, counterfactual experiments reveal that the model's handling of sentiment tasks primarily depends on information from demonstrations. The experimental results support the first viewpoint.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑