SegAugment:利用基于分段的增强最大化语音翻译数据的效用
SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentations
AI总结:
本文提出 SegAugment 数据增强方法,通过音频重分段与文本对齐生成多个句子级数据版本,在多语言语音翻译基准上显著提升性能并达到新的最先进水平。
摘要:
端到端语音翻译受到可用数据资源匮乏的阻碍。虽然大多数数据资源都基于文档,但也存在句子级版本;然而该版本是单一且静态的,可能会削弱数据的效用。我们提出一种新的数据增强策略 SegAugment,通过生成数据集的多个备选句子级版本来解决这一问题。我们的方法利用 Audio Segmentation(音频分段)系统,在不同的长度约束下对每个文档的语音重新分段,随后通过对齐方法获得目标文本。实验表明,在 MuST-C 的八个语言对上均取得一致收益,平均提升 2.5 BLEU 分;在 mTEDx 的低资源场景中,提升最高可达 5 BLEU。此外,与一个强系统结合时,SegAugment 在 MuST-C 上确立了新的最先进结果。最后,我们表明所提方法还能够成功增强句子级数据集,并使语音翻译模型在推理时缩小手动分段与自动分段之间的差距。
英文摘要:
End-to-end Speech Translation is hindered by a lack of available data resources. While most of them are based on documents, a sentence-level version is available, which is however single and static, potentially impeding the usefulness of the data. We propose a new data augmentation strategy, SegAugment, to address this issue by generating multiple alternative sentence-level versions of a dataset. Our method utilizes an Audio Segmentation system, which re-segments the speech of each document with different length constraints, after which we obtain the target text via alignment methods. Experiments demonstrate consistent gains across eight language pairs in MuST-C, with an average increase of 2.5 BLEU points, and up to 5 BLEU for low-resource scenarios in mTEDx. Furthermore, when combined with a strong system, SegAugment establishes new state-of-the-art results in MuST-C. Finally, we show that the proposed method can also successfully augment sentence-level datasets, and that it enables Speech Translation models to close the gap between the manual and automatic segmentation at inference time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。