arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.16650cs.CLcs.CEcs.CY
收藏

ESG情感分析:比较人类与语言模型(包括GPT)的表现

ESG Sentiment Analysis: comparing human and language model performance including GPT

University of Manchester(曼彻斯特大学)

Karim Derrick

AI总结:

本文通过构建150条推文的黄金标准数据集,比较人类与多种机器方法(包括VADER及Llama2、GPT4等语言模型)在ESG社交媒体情感分析中的表现。

摘要:

在本文中,我们探讨了在与环境、社会和治理(ESG)社交媒体相关的情感测量中所面临的挑战。近年来,ESG的重要性日益增长,金融行业对其兴趣激增,许多企业的表现已部分建立在其ESG相关声誉之上。使用情感分析来衡量ESG相关声誉的方法已经发展起来,随之而来的是对使用机器进行此类分析的兴趣。数字媒体时代在社交媒体平台增长的推动下,催生了新媒体来源的爆炸式增长。这一不断增长的数据环境已成为包括政治、医疗保健和市场研究在内的许多学科行为洞察研究的极佳来源。我们的研究旨在比较人类表现与机器在ESG相关情感测量中的前沿表现。为此,研究人员对150条推文的情感进行分类,并进行了可靠性测量。然后基于3位研究人员的共识建立了一个黄金标准数据集,该数据集随后被用于衡量不同机器方法的表现:一种基于VADER词典方法进行情感分类,然后是多种语言模型方法,包括Llama2、T5、Mistral、Mixtral、FINBERT、GPT3.5和GPT4。

英文摘要:

In this paper we explore the challenges of measuring sentiment in relation to Environmental, Social and Governance (ESG) social media. ESG has grown in importance in recent years with a surge in interest from the financial sector and the performance of many businesses has become based in part on their ESG related reputations. The use of sentiment analysis to measure ESG related reputation has developed and with it interest in the use of machines to do so. The era of digital media has created an explosion of new media sources, driven by the growth of social media platforms. This growing data environment has become an excellent source for behavioural insight studies across many disciplines that includes politics, healthcare and market research. Our study seeks to compare human performance with the cutting edge in machine performance in the measurement of ESG related sentiment. To this end researchers classify the sentiment of 150 tweets and a reliability measure is made. A gold standard data set is then established based on the consensus of 3 researchers and this data set is then used to measure the performance of different machine approaches: one based on the VADER dictionary approach to sentiment classification and then multiple language model approaches, including Llama2, T5, Mistral, Mixtral, FINBERT, GPT3.5 and GPT4.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑