人工不流利检测,呃不,为大众产生不流利
Artificial Disfluency Detection, Uh No, Disfluency Generation for the Masses
摘要:
用于不流利表达检测的现有方法通常需要大的注释数据集的存在。然而,当前用于此任务的数据集是有限的,存在类不平衡,并且缺乏在现实世界场景中可能遇到的某些类型的不流畅。这项工作提出了LARD,自动生成流畅的文本人工不流畅的方法。LARD可以模拟所有不同类型的不流畅(重复,替换和重新启动)基于reparhui/interregnum注释方案。此外,它将上下文嵌入到不流利的生成,以产生现实的上下文感知的人工不流利。由于所提出的方法只需要流畅的文本,它可以直接用于训练,绕过注释的不流畅数据的要求。我们的实证评估表明,LARD确实可以有效地使用时,没有或只有少数数据。此外,我们的详细分析表明,所提出的方法产生现实的不流利,并提高了现有的不流利检测器的准确性。
英文摘要:
Existing approaches for disfluency detection typically require the existence of large annotated datasets. However, current datasets for this task are limited, suffer from class imbalance, and lack some types of disfluencies that can be encountered in real-world scenarios. This work proposes LARD, a method for automatically generating artificial disfluencies from fluent text. LARD can simulate all the different types of disfluencies (repetitions, replacements and restarts) based on the reparandum/interregnum annotation scheme. In addition, it incorporates contextual embeddings into the disfluency generation to produce realistic context-aware artificial disfluencies. Since the proposed method requires only fluent text, it can be used directly for training, bypassing the requirement of annotated disfluent data. Our empirical evaluation demonstrates that LARD can indeed be effectively used when no or only a few data are available. Furthermore, our detailed analysis suggests that the proposed method generates realistic disfluencies and increases the accuracy of existing disfluency detectors.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。