In the field of dream research, the study of dream content typically relies on the analysis of verbal reports provided by dreamers upon awakening from their sleep. This task is classically performed through manual scoring provided by trained annotators, at a great time expense. While a consistent body of work suggests that natural language processing (NLP) tools can support the automatic analysis of dream reports, proposed methods lacked the ability to reason over a report's full context and required extensive data pre-processing. Furthermore, in most cases, these methods were not validated against standard manual scoring approaches. In this work, we address these limitations by adopting large language models (LLMs) to study and replicate the manual annotation of dream reports, using a mixture of off-the-shelf and bespoke approaches, with a focus on references to reports' emotions. Our results show that the off-the-shelf method achieves a low performance probably in light of inherent linguistic differences between reports collected in different (groups of) individuals. On the other hand, the proposed bespoke text classification method achieves a high performance, which is robust against potential biases. Overall, these observations indicate that our approach could find application in the analysis of large dream datasets and may favour reproducibility and comparability of results across studies.
The Effect of Emotional Context on Large Language Models' Endorsement of Premature Decisions: Comparing Emotional Vulnerability Across Six Commercial Models
Yonsei University(延世大学);Fudan University(复旦大学);St. Johnsbury Academy Jeju(济州圣约翰斯伯里学院)
Guiding Language Models to Be More Empathetic: Culturally Sensitive Mental Health Advice Generation Through Human-LLM Collaboration
Ahsanullah University of Science and Technology(阿山努拉科技大学);Bangladesh University of Business and Technology(孟加拉国商业与技术大学);The University of New South Wales(新南威尔士大学);Jashore University of Science and Technology(贾绍尔科技大学);American International University - Bangladesh(孟加拉国美国国际大学)
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Computer Science, Fudan University(复旦大学计算机科学学院);School of Information, Renmin University of China(中国人民大学信息学院)
C2F-Thinker: Coarse-to-Fine Reasoning with Hint-Guided Reinforcement Learning for Multimodal Sentiment Analysis
School of Computer Science, South China Normal University(华南师范大学计算机科学学院);School of Electronic and Information Engineering, South China University of Technology(华南理工大学电子与信息工程学院)
EmoS: A Theory-Grounded Framework for Evaluating and Aligning Emotional Intelligence in Spoken Language Models
Tianjin University(天津大学);Fuzhou University(福州大学);Shanghai Jiaotong University(上海交通大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)