This article presents an analysis of the influence of context information on dialog act recognition. We performed experiments on the widely explored Switchboard corpus, as well as on data annotated according to the recent ISO 24617-2 standard. The latter was obtained from the Tilburg DialogBank and through the mapping of the annotations of a subset of the Let's Go corpus. We used a classification approach based on SVMs, which had proved successful in previous work and allowed us to limit the amount of context information provided. This way, we were able to observe the influence patterns as the amount of context information increased. Our base features consisted of n-grams, punctuation, and wh-words. Context information was obtained from one to five preceding segments and provided either as n-grams or dialog act classifications, with the latter typically leading to better results and more stable influence patterns. In addition to the conclusions about the importance and influence of context information, our experiments on the Switchboard corpus also led to results that advanced the state-of-the-art on the dialog act recognition task on that corpus. Furthermore, the results obtained on data annotated according to the ISO 24617-2 standard define a baseline for future work and contribute for the standardization of experiments in the area.
Do You Know My Emotion? Emotion-Aware Strategy Recognition towards a Persuasive Dialogue System
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations
The Hong Kong Polytechnic University(香港理工大学);Zhengzhou University of Light Industry(郑州轻工业大学);Hebei University of Technology(河北工业大学);Halmstad University(哈尔姆斯塔德大学);Copenhagen University(哥本哈根大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);WeChat AI, Tencent Inc(腾讯公司微信AI)
以往的自动人格识别工作主要集中在使用传统的语言特征分类模型。然而,具有上下文嵌入的注意神经网络在文本分类中取得了巨大的成功,很少被探索用于这项任务。在这个项目中,我们有两个主要贡献。首先,我们创建了第一个基于对话的人格数据集,MysPersona,通过众包注释来自Friends TV Show的演讲者的5个人格特征。其次,我们提出了一种新的方法来自动人格识别使用预先训练的上下文嵌入(BERT和RoBERTa)和专注的神经网络。我们的模型在很大程度上将独白Essays数据集的最新结果提高了2.49%,并在我们的MonkeysPersona上建立了坚实的基准。通过比较两个数据集的结果,我们展示了在多方对话中建模个性的挑战。
A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction
School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);Institute of Artificial Intelligence (TeleAI), China Telecom Corp Ltd(人工智能研究所(TeleAI));Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing(丝绸之路多语种认知计算联合国际实验室);Xinjiang Key Laboratory of Multi-lingual Information Technology(新疆多语种信息处理重点实验室)
DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition
School of computer and Information Engineering, Central South University of Forestry and Technology(中南林业科技大学计算机与信息工程学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);State University of New York(纽约州立大学)
本文提出 DER-GCN 模型,通过构建加权多关系图并引入自监督掩码图自编码器、多信息 Transformer 和对比学习损失优化策略,有效融合对话关系与事件关系,在多模态对话情感识别任务上显著提升了准确率和 f1 值。
DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations
National Computer System Engineering Research Institute of China(中国国家计算机系统工程研究所);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学)
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);Peng Cheng Laboratory(鹏城实验室);Shanghai Key Laboratory of Intelligent Information Processing, Fudan University(复旦大学上海市智能信息处理重点实验室)
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations
National University of Singapore(新加坡国立大学);Instituto Politécnico Nacional(墨西哥国立理工学院);Nanyang Technological University(南洋理工大学);University of Michigan(密歇根大学)
Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);Institute of Artificial Intelligence, Huazhong University of Science and Technology(华中科技大学人工智能研究院);Hubei Key Laboratory of Brain-Inspired Intelligent Systems, Huazhong University of Science and Technology(华中科技大学脑启发智能系统省重点实验室);Key Laboratory of Image Processing and Intelligent Control (Huazhong University of Science and Technology), Ministry of Education(图像处理与智能控制重点实验室(华中科技大学))
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology (HUST)(华中科技大学人工智能与自动化学院);Institute of Artificial Intelligence, HUST(华中科技大学人工智能研究院);Hubei Key Laboratory of Brain-inspired Intelligent Systems, HUST(华中科技大学湖北省脑启发智能系统重点实验室);Key Laboratory of Image Processing and Intelligent Control (HUST), Ministry of Education(华中科技大学图像信息处理与智能控制教育部重点实验室)
DialogueVPR: Towards Conversational Visual Place Recognition
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Shandong Computer Science Center, Qilu University of Technology(山东省计算中心(国家超级计算济南中心),齐鲁工业大学);Macquarie University(麦考瑞大学);Spatialtemporal AI(时空人工智能公司);University of Macau(澳门大学);Aerospace Information Research Institute(航天信息研究所)