The Role of Vocal Persona in Natural and Synthesized Speech
Stanford University(斯坦福大学);Center for Computer Research in Music and Acoustics(计算机音乐与声学研究中心)
Camille Noufi, Lloyd May, Jonathan Berger
备注:
To be published in the proceedings of the 17th IEEE International Conference on Automatic Face and Gesture Recognition as part of the Workshop on Socially Interactive Human-like Virtual Agents (SIVA '23)
The inclusion of voice persona in synthesized voice can be significant in a broad range of human-computer-interaction (HCI) applications, including augmentative and assistive communication (AAC), artistic performance, and design of virtual agents. We propose a framework to imbue compelling and contextually-dependent expression within a synthesized voice by introducing the role of the vocal persona within a synthesis system. In this framework, the resultant 'tone of voice' is defined as a point existing within a continuous, contextually-dependent probability space that is traversable by the user of the voice. We also present initial findings of a thematic analysis of 10 interviews with vocal studies and performance experts to further understand the role of the vocal persona within a natural communication ecology. The themes identified are then used to inform the design of the aforementioned framework.
DS-TTS: Zero-Shot Speaker Style Adaptation from Voice Clips via Dynamic Dual-Style Feature Modulation
School of Data Science and Media Intelligence, Communication University of China(数据科学与媒体智能学院,中国传媒大学);Psyche AI Inc. Beijing, China(北京Psyche AI公司,中国);Hainan International College, Communication University of China(海南国际学院,中国传媒大学);Hangzhou International Innovation Institute, Beihang University(杭州国际创新研究院,北京理工大学)
Vocal Prognostic Digital Biomarkers in Monitoring Chronic Heart Failure: A Longitudinal Observational Study
Centre for Digital Health Interventions, ETH Zurich(苏黎世联邦理工学院数字健康干预中心);Agentic System Lab, ETH Zurich(苏黎世联邦理工学院代理系统实验室);Cardiology, University Heart Center Zurich, University Hospital Zurich(苏黎世大学医院心脏中心心脏病学);Center for Laryngeal Surgery and Voice Rehabilitation, Massachusetts General Hospital(麻省总医院喉外科与嗓音康复中心);Department of Surgery, Harvard Medical School(哈佛医学院外科学系);Speech and Hearing Bioscience and Technology, Division of Medical Sciences, Harvard Medical School(哈佛医学院医学科学部言语与听觉生物科学与技术);MGH Institute of Health Professions(麻省总医院健康职业学院);Centre for Digital Health Interventions, University of St. Gallen(圣加仑大学数字健康干预中心)
Profiling the Voice: Speaker-Specific Phoneme Fingerprinting for Speech Deepfake Detection
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education(航空航天信息安全与可信计算重点实验室,教育部);School of Cyber Science and Engineering, Wuhan University(武汉大学计算机科学与工程学院)