SingingSDS: 一种具备歌唱能力的语音对话系统用于对话角色扮演应用
SingingSDS: A Singing-Capable Spoken Dialogue System for Conversational Roleplay Applications
AI总结：
SingingSDS是一种通过歌唱回应的语音对话系统，旨在通过更情感化和愉悦的交互提升角色扮演和互动娱乐体验。
摘要：
随着自动语音识别（ASR）、大语言模型（LLMs）和文本到语音（TTS）技术的最新进展，语音对话系统（SDS）已变得广泛应用。然而，大多数现有的SDS仅限于传统的语音响应。我们提出了SingingSDS，一种级联的SDS，通过歌唱而非说话来回应，从而在基于角色的角色扮演和互动娱乐场景中促进更具情感、记忆深刻和愉悦的交互。SingingSDS采用了一个模块化的ASR-LLM-SVS流水线，并支持在角色人设、ASR和LLM后端、SVS模型、旋律来源和声音profile之间广泛配置，以满足不同需求在延迟、质量和音乐风格方面。SingingSDS作为插件式网页演示可用，具有模块化、开源代码，支持定制和扩展。演示：https://huggingface.co/spaces/espnet/SingingSDS。代码：https://github.com/SingingSDS/SingingSDS。
英文摘要：
With recent advances in automatic speech recognition (ASR), large language models (LLMs), and text-to-speech (TTS) technologies, spoken dialogue systems (SDS) have become widely accessible. However, most existing SDS are limited to conventional spoken responses. We present SingingSDS, a cascaded SDS that responds through singing rather than speaking, fostering more affective, memorable, and pleasurable interactions in character-based roleplay and interactive entertainment scenarios. SingingSDS employs a modular ASR-LLM-SVS pipeline and supports a wide range of configurations across character personas, ASR and LLM backends, SVS models, melody sources, and voice profiles, tailored to different needs in terms of latency, quality, and musical style. SingingSDS is available as a plug-and-play web demo, featuring modular, open-source code that supports customization and extension. Demo: https://huggingface.co/spaces/espnet/SingingSDS. Code: https://github.com/SingingSDS/SingingSDS.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
