AP-GRPO: 基于锚定门控语音对齐与策略优化的病理语音重建
AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction
AI总结:
针对神经退行性和神经运动障碍患者的病理语音,提出AP-GRPO框架,通过锚定门控奖励和语音对齐奖励优化语音语言模型,实现忠实重建,并揭示疾病特异性模式。
摘要:
来自神经退行性和神经运动障碍患者的病理语音通常在声学上失真且语言上支离破碎,因此需要病理语音重建来从失真和不完整的语音录音中恢复预期的文本内容。关键在于,此类录音很少均匀退化:一些单词或短语仍然可靠,可以作为可听锚点来重建受损的周围内容。我们引入了锚定门控语音组相对策略优化(AP-GRPO),这是一个带有语音奖励的GRPO框架,通过可听锚点保留和锚点间语音兼容性来对齐语音语言模型(SLM)与原始语音信号。AP-GRPO包括:(i)一个锚定门控奖励,用于匹配清晰区域中的可靠可听锚点;(ii)一个锚点间语音对齐奖励,用于评估恢复的内容是否在语音上得到相应受损锚点间语音片段的支持。在四种疾病条件下,AP-GRPO提高了忠实语音重建,并且学习的锚点约束自动适应每种条件,从而揭示可解释的疾病特异性特征:严重发音退化条件需要更强的锚点强制,而轻度损伤或语言障碍条件则更依赖于锚点间恢复的语音对齐。
英文摘要:
Pathological speech from patients with neurodegenerative and neuromotor disorders is often acoustically distorted and linguistically fragmented, making pathological speech reconstruction necessary to recover intended textual content from distorted and incomplete speech recordings. Crucially, such recordings are rarely uniformly degraded: some words or short phrases remain reliable and can serve as audible anchors for reconstructing the corrupted surrounding content. We introduce Anchor-gated Phonetic Group Relative Policy Optimization (AP-GRPO), a GRPO framework with phonetic reward that aligns speech language models (SLMs) through audible-anchor preservation and inter-anchor phonetic compatibility to the original speech signal. AP-GRPO consists of: (i) an anchor-gated reward that matches reliable audible anchors in clear regions; and (ii) an inter-anchor phonetic alignment reward that evaluates whether recovered contents are phonetically supported by the corresponding corrupted inter-anchor speech span. Across four disease conditions, AP-GRPO improves faithful speech reconstruction, and the learned anchor constraint automatically adapts to each condition and thus reveals interpretable disease-specific profiles: conditions with severe articulatory degradation require stronger anchor enforcement, whereas milder impairment or linguistically impaired conditions rely more on phonetic alignment for inter-anchor recovery.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。