arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1601.02789cs.CLstat.APstat.ML
收藏

复述质量自动评估系统的比较与适应

Comparison and Adaptation of Automatic Evaluation Metrics for Quality Assessment of Re-Speaking

Krzysztof Wołk, Danijel Koržinek

摘要:

重新说话是一种获得高质量字幕的机制,用于现场直播和其他公共活动。因为它依赖于人类执行实际的复述,所以估计结果质量的任务是不平凡的。大多数组织依靠人类来执行实际的质量评估,但对于其他类似问题,如机器翻译,已经开发了纯自动方法。本文将尝试比较几种方法:BLEU,EBLEU,NIST,METEOR,METEOR-PL,TER和RIBES。然后,这些将被匹配到人类派生的NER度量,通常用于重新说话。

英文摘要:

Re-speaking is a mechanism for obtaining high quality subtitles for use in live broadcast and other public events. Because it relies on humans performing the actual re-speaking, the task of estimating the quality of the results is non-trivial. Most organisations rely on humans to perform the actual quality assessment, but purely automatic methods have been developed for other similar problems, like Machine Translation. This paper will try to compare several of these methods: BLEU, EBLEU, NIST, METEOR, METEOR-PL, TER and RIBES. These will then be matched to the human-derived NER metric, commonly used in re-speaking.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑