arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2506.05688cs.SDcs.CLcs.LGeess.AS

零 shot TTS 中的语音印象控制

Voice Impression Control in Zero-Shot TTS

NTT, Inc.(日本电报电话公司)

Kenichi Fujita, Shota Horiguchi, Yusuke Ijima

AI总结:

本文提出了一种基于大型语言模型的零 shot TTS 语音印象控制方法,通过低维向量实现语音印象的自动调节与生成。

摘要:

语音中的参数/非语言信息在塑造听众印象方面至关重要。尽管零 shot 文本到语音(TTS)已经实现了高说话者保真度,但调节细微的参数/非语言信息以控制感知的语音特征,即印象,仍然具有挑战性。为此,我们开发了一种零 shot TTS 中的语音印象控制方法,该方法利用低维向量来表示各种语音印象对(例如,深浅)。客观和主观评估的结果都证明了我们方法在印象控制上的有效性。此外,通过大型语言模型生成此向量,可以从自然语言描述的期望印象生成目标印象,从而消除了手动优化的需要。音频示例可在我们的演示页面上获得(https://ntt-hilab-gensp.github.io/is2025voiceimpression/)。

英文摘要:

Para-/non-linguistic information in speech is pivotal in shaping the listeners' impression. Although zero-shot text-to-speech (TTS) has achieved high speaker fidelity, modulating subtle para-/non-linguistic information to control perceived voice characteristics, i.e., impressions, remains challenging. We have therefore developed a voice impression control method in zero-shot TTS that utilizes a low-dimensional vector to represent the intensities of various voice impression pairs (e.g., dark-bright). The results of both objective and subjective evaluations have demonstrated our method's effectiveness in impression control. Furthermore, generating this vector via a large language model enables target-impression generation from a natural language description of the desired impression, thus eliminating the need for manual optimization. Audio examples are available on our demo page (https://ntt-hilab-gensp.github.io/is2025voiceimpression/).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑