arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.05265eess.AScs.SD
收藏

受说话人切换检测启发的口语语言切换检测

Spoken language change detection inspired by speaker change detection

IIT Dharwad(达尔瓦德印度理工学院)

Jagabandhu Mishra, S. R. Mahadeva Prasanna

AI总结:

本文借鉴说话人切换检测框架研究语言切换检测,通过增大分析窗口并利用先验语言知识,在合成与真实语码转换数据集上显著提升性能。

摘要:

口语语言切换检测(LCD)是指识别语码转换话语中的语言切换。类似地,识别多说话人话语中的说话人切换被称为说话人切换检测(SCD)。由于这两项任务在任务层面相似,为SCD任务开发的架构或框架可能也适用于LCD任务。因此,本工作的目标是开发受SCD启发的LCD系统。首先,LCD和SCD均由人类完成。研究表明,与执行SCD相比,人类执行LCD时需要:(a)切换点附近更长的时长,以及(b)针对特定语言的先验接触经验。通过增加无监督基于距离方法的分析窗口长度,研究纳入了更长时长的需求。这带来了29.1%和2.4%的相对性能提升;而先验语言知识在合成和实际语码转换数据集上分别带来31.63%和14.27%的相对提升。实际数据集与合成数据集之间的性能差异主要源于单语片段时长分布的不同。

英文摘要:

Spoken language change detection (LCD) refers to identifying the language transitions in a code-switched utterance. Similarly, identifying the speaker transitions in a multispeaker utterance is known as speaker change detection (SCD). Since tasks-wise both are similar, the architecture/framework developed for the SCD task may be suitable for the LCD task. Hence, the aim of the present work is to develop LCD systems inspired by SCD. Initially, both LCD and SCD are performed by humans. The study suggests humans require (a) a larger duration around the change point and (b) language-specific prior exposure, for performing LCD as compared to SCD. The larger duration requirement is incorporated by increasing the analysis window length of the unsupervised distance-based approach. This leads to a relative performance improvement of 29.1% and 2.4%, and a priori language knowledge provides a relative improvement of 31.63% and 14.27% on the synthetic and practical codeswitched datasets, respectively. The performance difference between the practical and synthetic datasets is mostly due to differences in the distribution of the monolingual segment duration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑