arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.06246cs.CL
收藏

在灵活性与一致性之间:字幕与字幕的联合生成

Between Flexibility and Consistency: Joint Generation of Captions and Subtitles

Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会);University of Trento(特伦托大学)

Alina Karakanta, Marco Gaido, Matteo Negri, Marco Turchi

摘要:

语音翻译(ST)近来对于生成字幕而不需要中间源语言转录和定时(即字幕)受到越来越多的关注。然而,源字幕和目标字幕的联合生成不仅在两个解码过程相互通知时带来潜在的输出质量优势,而且在多语言场景中也经常需要。在这项工作中,我们专注于ST模型,产生一致的字幕,字幕的结构和词汇内容。我们进一步引入新的指标,评估字幕的一致性。我们的研究结果表明,联合解码导致提高性能和生成的字幕和字幕之间的一致性,同时仍然允许足够的灵活性,以产生符合特定语言的需求和规范的字幕。

英文摘要:

Speech translation (ST) has lately received growing interest for the generation of subtitles without the need for an intermediate source language transcription and timing (i.e. captions). However, the joint generation of source captions and target subtitles does not only bring potential output quality advantages when the two decoding processes inform each other, but it is also often required in multilingual scenarios. In this work, we focus on ST models which generate consistent captions-subtitles in terms of structure and lexical content. We further introduce new metrics for evaluating subtitling consistency. Our findings show that joint decoding leads to increased performance and consistency between the generated captions and subtitles while still allowing for sufficient flexibility to produce subtitles conforming to language-specific needs and norms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑