arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00946cs.SDcs.AIeess.AS
收藏

一种基于大语言模型的合成音频对话生成框架

A Framework for Synthetic Audio Conversations Generation using Large Language Models

Innovative Cognitive Computing (IC2) Research Center(创新认知计算(IC2)研究中心);School of Information Technology(信息科技学院);King Mongkut's University of Technology Thonburi(泰国科技理工大学)

Kaung Myat Kyaw, Jonathan Hoyin Chan

AI总结:

本文提出ConversaSynth框架,利用多角色大语言模型生成文本对话并经TTS转为音频,以构建多样逼真的合成数据集,用于提升音频分类、标记及多说话人语音识别模型的训练与评估。

摘要:

本文介绍了ConversaSynth,一个旨在利用具有多角色设定的大语言模型(LLMs)生成合成对话音频的框架。该框架首先围绕多个主题生成多样且连贯的基于文本的对话,然后通过文本转语音(TTS)系统将其转换为音频。我们的实验表明,ConversaSynth能够有效生成高质量的合成音频数据集,这些数据集可显著增强音频标记、音频分类以及多说话人语音识别模型的训练与评估。结果表明,ConversaSynth生成的合成数据集具有显著的多样性和真实感,使其适用于开发鲁棒、可适应的基于音频的AI系统。

英文摘要:

In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based dialogues across various topics, which are then converted into audio using text-to-speech (TTS) systems. Our experiments demonstrate that ConversaSynth effectively generates highquality synthetic audio datasets, which can significantly enhance the training and evaluation of models for audio tagging, audio classification, and multi-speaker speech recognition. The results indicate that the synthetic datasets generated by ConversaSynth exhibit substantial diversity and realism, making them suitable for developing robust, adaptable audio-based AI systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑