Fine-Grained Quantitative Emotion Editing for Speech Generation
School of Data Science（数据科学学院）；Shenzhen Research Institute of Big Data（深圳大数据研究院）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Alibaba Group（阿里巴巴集团）
如何在语音生成中定量控制语音情感的表现力仍然是一个重大挑战。本文提出了一种用于操控语音生成中情感渲染的新方法。我们设计了一种分层情感分布提取器，即 Hierarchical ED，用于在不同粒度层级上量化情感强度。采用支持向量机（SVM）对情感强度进行排序，从而得到分层情感嵌入。随后，Hierarchical ED 被集成到 FastSpeech2 框架中，引导模型在音素、词和语句三个层级上学习情感强度。在合成过程中，用户可以手动编辑生成语音的情感强度。客观和主观评估均证明了所提出网络在细粒度定量情感编辑方面的有效性。
英文摘要：
It remains a significant challenge how to quantitatively control the expressiveness of speech emotion in speech generation. In this work, we present a novel approach for manipulating the rendering of emotions for speech generation. We propose a hierarchical emotion distribution extractor, i.e. Hierarchical ED, that quantifies the intensity of emotions at different levels of granularity. Support vector machines (SVMs) are employed to rank emotion intensity, resulting in a hierarchical emotional embedding. Hierarchical ED is subsequently integrated into the FastSpeech2 framework, guiding the model to learn emotion intensity at phoneme, word, and utterance levels. During synthesis, users can manually edit the emotional intensity of the generated voices. Both objective and subjective evaluations demonstrate the effectiveness of the proposed network in terms of fine-grained quantitative emotion editing.
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
Towards Emotionally Consistent Text-Based Speech Editing: Introducing EmoCorrector and The ECD-TSE Dataset
Johns Hopkins University（约翰霍普金斯大学）；Carnegie Mellon University（卡内基梅隆大学）；The Chinese University of Hong Kong（香港中文大学）；National University of Singapore（新加坡国立大学）；Inner Mongolia University（内蒙古大学）
AffectSpeech: A Large-Scale Emotional Speech Dataset with Fine-Grained Textual Descriptions for Speech Emotion Captioning and Synthesis
School of Biological Science and Medical Engineering, Southeast University（东南大学生物科学与医学工程学院）；Key Laboratory of Child Development and Learning Science (Southeast University), Ministry of Education（教育部儿童发展与学习科学重点实验室（东南大学））；Chair of Health Informatics (CHI), Technical University of Munich（慕尼黑工业大学健康信息学教席）；Group on Language, Audio, & Music (GLAM), Imperial College London（帝国理工学院语言、音频与音乐组）；Shenzhen Loop Area Institute（深圳河套学院）；Shenzhen Research Institute of Big Data, School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen（深圳市大数据研究院，香港中文大学（深圳）人工智能学院）
Emo-LiPO: Listwise Preference Optimization for Fine-Grained Emotion Intensity Control in LLM-based Text-to-Speech
The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Agency for Science, Technology and Research（新加坡科技研究局）；National University of Singapore（新加坡国立大学）；Shenzhen Research Institute of Big Data（深圳市大数据研究院）；Shenzhen Loop Area Institute（深圳河套学院）
Towards LLM-Empowered Fine-Grained Speech Descriptors for Explainable Emotion Recognition
The Chinese University of Hong Kong（香港中文大学）；Chinese Academy of Sciences（中国科学院）；National Research Council Canada（加拿大国家研究理事会）；Institute of Software（软件研究所）
Attention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion
School of Computer Science and Engineering, Sun Yat-Sen University（中山大学计算机科学与工程学院）；Guangdong Province Key Laboratory of Information Security Technology（广东省信息安全技术重点实验室）；Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education（教育部机器智能与先进计算重点实验室）
Fine-grained Speech Sentiment Analysis in Chinese Psychological Support Hotlines Based on Large-scale Pre-trained Model
School of Software Engineering, Beijing University of Technology（北京工业大学软件学院）；Peking University Huilongguan Clinical Medical School（北京大学回龙湖临床医学院）；Sorbonne Université（索邦大学）；Institut du Cerveau – Paris Brain Institute - ICM（巴黎脑研究所）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗援助医院）；Hôpital de la Pitié-Salpêtrière（皮蒂-萨尔佩特里埃医院）
Emotion Intensity and its Control for Emotional Voice Conversion
National University of Singapore（新加坡国立大学）；Singapore University of Technology and Design（新加坡科技设计大学）；University of Southern Queensland（南昆士兰大学）；Imperial College London（帝国理工学院）；University of Augsburg（奥格斯堡大学）；University of Bremen（不来梅大学）
