This paper investigates the design of effective prompt strategies for generating realistic datasets using Text-To-Audio (TTA) models. We also analyze different techniques for efficiently combining these datasets to enhance their utility in sound classification tasks. By evaluating two sound classification datasets with two TTA models, we apply a range of prompt strategies. Our findings reveal that task-specific prompt strategies significantly outperform basic prompt approaches in data generation. Furthermore, merging datasets generated using different TTA models proves to enhance classification performance more effectively than merely increasing the training dataset size. Overall, our results underscore the advantages of these methods as effective data augmentation techniques using synthetic data.
Audio-Mind: An Auditable Agentic Framework for Audio Understanding
School of Intelligence Science and Technology, Nanjing University, China(南京大学智能科学与技术学院);Department of Computer Science, ETH Zürich, Switzerland(苏黎世联邦理工学院计算机科学系);X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China(上海交通大学计算机科学学院X-LANCE实验室);School of Automation Science and Engineering, Xi’an Jiaotong University, China(西安交通大学自动化科学与工程学院);School of Computer Science, Northwestern Polytechnical University, China(西北工业大学计算机科学学院)
Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTS
Tianjin Key Laboratory of Cognitive Computing and Application, College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部认知计算与应用天津市重点实验室);Kuaishou Technology Co., Ltd(快手科技有限公司);Institute of Artificial Intelligence, China Telecom(中国电信人工智能研究院);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Huiyan Technology (Tianjin) Co., Ltd(慧眼科技(天津)有限公司)
Deterministic Prompting for Speaker-Stable Low-Resource Greek TTS
Institute for Language and Speech Processing, Athena R.C.(雅典娜研究与创新中心语言与语音处理研究所);Department of Digital Medicine, University of Bern(伯尔尼大学数字医学系);School of Electrical and Computer Engineering, National Technical University of Athens(雅典国家技术大学电气与计算机工程学院)
Speak Your Mind: The Speech Continuation Task as a Probe of Voice-Based Model Bias
Department of Speech, Music and Hearing, KTH Royal Institute of Technology(语音、音乐与听觉系,皇家理工学院);Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab(格勒诺布尔阿尔卑斯大学,法国国家科学研究中心,格勒诺布尔理工学院,GIPSA实验室)