arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

短语定位的语言对比引导:无训练的代码切换文本到语音的本地化重音控制

Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech

Che Hyun Lee, Sangkwon Park, Donghun Kang, Dongwook Lee, Youngho Cho, Heeseung Kim, Sungroh Yoon

arXiv 2609.01016首次发表:更新:

发表机构

Seoul National University; University of Seoul(首尔大学; 首尔市立大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

该研究针对代码切换文本到语音的重音偏差问题,提出无训练的短语定位语言对比引导框架,通过自注意力探测定位短语边界,实现各语言区域重音的准确控制,提升代码切换语音的原生度与自然度。

AI 中文摘要

当前语音合成在代码切换场景中存在困难,代码切换指将外语短语混入母语语句,导致该短语采用母语重音而非其原生重音。本文提出短语定位的语言对比引导(Language-Contrastive Guidance, LCG),这是一种无训练的推理框架,用于在跨语言文本到语音中恢复代码切换短语的原生重音。LCG将应用于整个语句的单一语言引导替换为针对每个区域的单独引导,使各部分受自身语言引导。为选择应用该本地化引导的位置,本文提出一种自注意力探测技术,无需外部对齐即可找到短语边界。这些组件共同生成的语音中,每个区域带有自身语言的重音,无需微调或辅助模型。在不同语言对中,LCG可显著提升代码切换短语的原生度,同时抑制重音泄漏,并保留整体说话人身份与自然度。

英文摘要

Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We propose Phrase-Localized Language-Contrastive Guidance (LCG), a training-free inference framework that restores a native accent to code-switched phrases in cross-lingual text-to-speech. LCG replaces the single language guidance applied across the whole utterance with a separate guidance for each region, so each part is guided by its own language. To choose where to apply this localized guidance, we propose a self-attention probing technique that finds the phrase boundaries without external alignments. Together, these components generate speech in which each region carries the accent of its own language, requiring no fine-tuning or auxiliary models. Across diverse language pairs, LCG robustly increases the nativeness of the code-switched phrase while suppressing accent leakage, and preserving overall speaker identity and naturalness.

CommentsAccepted to EMNLP 2026 (Main Conference). Demo: https://saga1214.github.io/PhraseLocalizedLCG/

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑