有声书的韵律分析
Prosody Analysis of Audiobooks
AI总结：
本研究利用93对书籍-有声书数据集，提出基于语言建模的改进模型预测韵律属性，其预测的音高和音量比先进商业TTS系统更接近人类朗读，并通过人类评估证实了韵律增强有声书的偏好度。
摘要：
文本转语音的最新进展使得从文本生成自然听感的音频成为可能。然而，有声书朗读涉及读者极具戏剧性的发声和语调，更依赖叙述中的情感、对话和描写。利用我们包含93对对齐的书籍-有声书数据集，我们提出了基于语言建模的改进模型，用于从叙事文本预测韵律属性（音高、音量和语速）。我们预测的韵律属性与人类有声书朗读的相关性远优于某先进商业TTS系统的结果：在24本书中有22本，我们预测的音高与人类朗读显示出更高的相关性；而在24本书中有23本，我们预测的音量属性被证明更接近人类朗读。最后，我们提出了一项人类评估研究，以量化人们相较于商业文本转语音系统更偏好韵律增强有声书朗读的程度。
英文摘要：
Recent advances in text-to-speech have made it possible to generate natural-sounding audio from text. However, audiobook narrations involve dramatic vocalizations and intonations by the reader, with greater reliance on emotions, dialogues, and descriptions in the narrative. Using our dataset of 93 aligned book-audiobook pairs, we present improved models for prosody prediction properties (pitch, volume, and rate of speech) from narrative text using language modeling. Our predicted prosody attributes correlate much better with human audiobook readings than results from a state-of-the-art commercial TTS system: our predicted pitch shows a higher correlation with human reading for 22 out of the 24 books, while our predicted volume attribute proves more similar to human reading for 23 out of the 24 books. Finally, we present a human evaluation study to quantify the extent that people prefer prosody-enhanced audiobook readings over commercial text-to-speech systems.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
