Emotion Classification based on text is a task with many applications which has received growing interest in recent years. This paper presents a preliminary study with the goal to help researchers and practitioners gain insight into relatively new datasets as well as emotion classification in general. We focus on three datasets that were recently presented in the related literature, and we explore the performance of traditional as well as state-of-the-art deep learning models in the presence of different characteristics in the data. We also explore the use of data augmentation in order to improve performance. Our experimental work shows that state-of-the-art models such as RoBERTa perform the best for all cases. We also provide observations and discussion that highlight the complexity of emotion classification in these datasets and test out the applicability of the models to actual social media posts we collected and labeled.
Attention-based Modeling for Emotion Detection and Classification in Textual Conversations
LIRMM UMR 5506;CNRS(法国国家科学研究中心);University of Montpellier(蒙彼利埃大学);IUT de Béziers(贝济耶大学技术学院);AMIS;Paul Valery University - Montpellier 3(保罗·瓦莱里大学-蒙彼利埃第三大学)
Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi’an Jiaotong University(西安交通大学教育部长江网络与网络安全重点实验室);College of Computer and Mathematics, Central South University of Forestry and Technology(中南林业科技大学计算机与数学学院);Department of Computer Science, State University of New York(纽约州立大学新帕尔茨分校计算机科学系)
Feel the Difference? A Comparative Analysis of Emotional Arcs in Real and LLM-Generated CBT Sessions
Department of Computer Science, Shantou University(汕头大学计算机科学系);Department of Automation, Tsinghua University(清华大学自动化系);BNRIST, Tsinghua University(清华大学脑科学与类脑智能研究院)
How People Respond to the COVID-19 Pandemic on Twitter: A Comparative Analysis of Emotional Expressions from US and India
Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(高性能计算研究所,新加坡科技研究局);Centre for Artificial Intelligence Research, University of Agder(阿格德大学人工智能研究中心);Department of Psychology, Northwestern University(西北大学心理学系)
Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Dataset
Inner Mongolia University(内蒙古大学);Chinese Academy of Sciences(中国科学院);South China University of Technology(华南理工大学);Technical University of Munich(慕尼黑工业大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Emotion detection of social data: APIs comparative study
The University of Jordan(约旦大学);Curtin University(科廷大学);Al-Balqa Applied University(拜勒加应用大学)
情感检测技术的发展已经成为企业界一种非常有价值的可能性,因为这一新学科几乎可以无限使用,特别是随着社交数据的不断传播。近年来,电子市场见证了大量初创企业的建立,这些企业几乎专注于构建新的商业和开源工具以及用于情感检测和识别的API。然而,这些工具和API必须不断地进行审查和评估,并且应该报告和讨论它们的性能。目前缺乏研究来实证比较当前的情感检测技术,从每个模型使用相同的文本数据集获得的结果。此外,还缺乏对社会数据进行基准比较的比较研究。这项研究比较了八种技术; IBM Watson NLU,Symanto-Ekman,Crystalfeel,Text to Emotion,Senpy,Textprobe和NLP Cloud。使用两个不同的数据集进行比较。然后使用合并的API导出来自所选数据集的情绪。这些API的性能是使用它们提供的汇总分数以及理论上经过验证的评估指标(如准确性,分类错误,精确度,召回率和f1分数的微平均值)进行评估的。最后,这些原料药纳入评估措施的评估报告和讨论。
A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories
Department of Electronics, Information, and Bioengineering, Polytechnic University of Milan(米兰理工学院电子、信息与生物工程系);Multimedia Mining and Search Group, Institute of Computational Perception, Johannes Kepler University Linz(莱茵河畔林茨约翰·凯撒大学计算感知研究所多媒体挖掘与检索小组);Department of Music Pedagogy, Nuremberg University of Music(纽伦堡音乐学院音乐教育系);Human-centered AI Group, AI Lab, Linz Institute of Technology(林茨技术学院以人为本的人工智能小组)
Sentiment and Emotion Classification of Epidemic Related Bilingual data from Social Media
Al-Khawarizmi Institute of Computer Sciences(花拉子米计算机科学研究所);University of Engineering & Technology(工程技术大学)
情感分析和情感分类是近年来自然语言处理(Natural Language Processing,NLP)领域中应用最为广泛的两种技术。虽然情感分析和情感分类通常用于分析客户评论,竞选候选人的受欢迎程度以及对各种体育赛事的评论等应用程序,但在本研究中,我们研究了它们在流行病爆发检测中的应用。早期发现疫情是有效应对疫情的关键,然而,传统的疫情发现方法耗时长,阻碍了相关部门的及时反应。社交媒体平台,如Twitter,Facebook,Instagram等,允许用户表达他们对生活不同方面的想法,因此,在这种情况下,作为一个重要的信息来源。该研究利用了来自Twitter和NEWS网站的双语(乌尔都语和英语)数据,这些数据与巴基斯坦的登革热疫情有关,并进行了情感分析和情感分类,以从数据集中获得深刻的见解,从而获得与疫情爆发有关的公平想法。机器学习和深度学习算法已被用于训练和实现用于执行这两项任务的模型。每个模型的比较性能进行了评估,使用准确率,精度,召回率和f1-措施。
Do Large Language Models Possess a Theory of Mind? A Comparative Evaluation Using the Strange Stories Paradigm
ELTE Research Centre for Linguistics(ELTE语言学研究中心);Department of Cognitive Science, Faculty of Natural Sciences, Budapest University of Technology and Economics(布达佩斯技术与经济大学自然科学学院认知科学系);Institute of Mathematics, Eötvös Lóránd University(欧多布雷尼大学数学研究所)
Expansion Quantization Network: An Efficient Micro-emotion Annotation and Detection Framework
School of Information and Electronics, Beijing Institute of Technology(北京理工大学信息与电子学院);Institute of Scientific and Technical Research on Archives(档案科学技术研究所);China Electronics Engineering Design Institute Co., Ltd.(中国电子工程设计院有限公司)