Dialogue act recognition is an important component of a large number of natural language processing pipelines. Many research works have been carried out in this area, but relatively few investigate deep neural networks and word embeddings. This is surprising, given that both of these techniques have proven exceptionally good in most other language-related domains. We propose in this work a new deep neural network that explores recurrent models to capture word sequences within sentences, and further study the impact of pretrained word embeddings. We validate this model on three languages: English, French and Czech. The performance of the proposed approach is consistent across these languages and it is comparable to the state-of-the-art results in English. More importantly, we confirm that deep neural networks indeed outperform a Maximum Entropy classifier, which was expected. However , and this is more surprising, we also found that standard word2vec em-beddings do not seem to bring valuable information for this task and the proposed model, whatever the size of the training corpus is. We thus further analyse the resulting embeddings and conclude that a possible explanation may be related to the mismatch between the type of lexical-semantic information captured by the word2vec embeddings, and the kind of relations between words that is the most useful for the dialogue act recognition task.
Do You Know My Emotion? Emotion-Aware Strategy Recognition towards a Persuasive Dialogue System
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations
The Hong Kong Polytechnic University(香港理工大学);Zhengzhou University of Light Industry(郑州轻工业大学);Hebei University of Technology(河北工业大学);Halmstad University(哈尔姆斯塔德大学);Copenhagen University(哥本哈根大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);WeChat AI, Tencent Inc(腾讯公司微信AI)
以往的自动人格识别工作主要集中在使用传统的语言特征分类模型。然而,具有上下文嵌入的注意神经网络在文本分类中取得了巨大的成功,很少被探索用于这项任务。在这个项目中,我们有两个主要贡献。首先,我们创建了第一个基于对话的人格数据集,MysPersona,通过众包注释来自Friends TV Show的演讲者的5个人格特征。其次,我们提出了一种新的方法来自动人格识别使用预先训练的上下文嵌入(BERT和RoBERTa)和专注的神经网络。我们的模型在很大程度上将独白Essays数据集的最新结果提高了2.49%,并在我们的MonkeysPersona上建立了坚实的基准。通过比较两个数据集的结果,我们展示了在多方对话中建模个性的挑战。
A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction
School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);Institute of Artificial Intelligence (TeleAI), China Telecom Corp Ltd(人工智能研究所(TeleAI));Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing(丝绸之路多语种认知计算联合国际实验室);Xinjiang Key Laboratory of Multi-lingual Information Technology(新疆多语种信息处理重点实验室)
DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition
School of computer and Information Engineering, Central South University of Forestry and Technology(中南林业科技大学计算机与信息工程学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);State University of New York(纽约州立大学)
本文提出 DER-GCN 模型,通过构建加权多关系图并引入自监督掩码图自编码器、多信息 Transformer 和对比学习损失优化策略,有效融合对话关系与事件关系,在多模态对话情感识别任务上显著提升了准确率和 f1 值。
DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations
National Computer System Engineering Research Institute of China(中国国家计算机系统工程研究所);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学)
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);Peng Cheng Laboratory(鹏城实验室);Shanghai Key Laboratory of Intelligent Information Processing, Fudan University(复旦大学上海市智能信息处理重点实验室)
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations
National University of Singapore(新加坡国立大学);Instituto Politécnico Nacional(墨西哥国立理工学院);Nanyang Technological University(南洋理工大学);University of Michigan(密歇根大学)
Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);Institute of Artificial Intelligence, Huazhong University of Science and Technology(华中科技大学人工智能研究院);Hubei Key Laboratory of Brain-Inspired Intelligent Systems, Huazhong University of Science and Technology(华中科技大学脑启发智能系统省重点实验室);Key Laboratory of Image Processing and Intelligent Control (Huazhong University of Science and Technology), Ministry of Education(图像处理与智能控制重点实验室(华中科技大学))
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology (HUST)(华中科技大学人工智能与自动化学院);Institute of Artificial Intelligence, HUST(华中科技大学人工智能研究院);Hubei Key Laboratory of Brain-inspired Intelligent Systems, HUST(华中科技大学湖北省脑启发智能系统重点实验室);Key Laboratory of Image Processing and Intelligent Control (HUST), Ministry of Education(华中科技大学图像信息处理与智能控制教育部重点实验室)
Dialogue Systems Can Generate Appropriate Responses without the Use of Question Marks? -- Investigation of the Effects of Question Marks on Dialogue Systems