arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.06004cs.SDeess.ASeess.SP
收藏

基于迁移学习和声学-词汇信息融合的语音升级检测

Detecting Escalation Level from Speech with Transfer Learning and Acoustic-Lexical Information Fusion

Duke Kunshan University(昆山杜克大学);Wuhan University(武汉大学)

Ziang Zhou, Yanze Xu, Ming Li

摘要:

文本升级检测已经广泛应用于电子商务公司的客户服务系统,以预先警告和防止潜在的冲突。类似地,在诸如机场和训练站之类的公共区域中,经常发生许多非个人的谈话,基于声学的升级检测系统也可用于增强乘客的安全并维持公共秩序。为此,我们引入了一个系统的基础上的声学词汇特征来检测升级从语音,语音活动检测(VAD)和标签平滑,以进一步提高我们的实验中的性能。考虑到一小组训练和开发数据,我们还在几个著名的情感检测数据集上采用迁移学习,即RAVDESS,CREMA-D,以学习高级情感表示,然后将其应用于会话升级检测任务。在开发集上,我们提出的系统实现了81.5%的未加权平均召回率(UAR),显着优于基线72.2%的UAR。

英文摘要:

Textual escalation detection has been widely applied to e-commerce companies' customer service systems to pre-alert and prevent potential conflicts. Similarly, in public areas such as airports and train stations, where many impersonal conversations frequently take place, acoustic-based escalation detection systems are also useful to enhance passengers' safety and maintain public order. To this end, we introduce a system based on acoustic-lexical features to detect escalation from speech, Voice Activity Detection (VAD) and label smoothing are adopted to further enhance the performance in our experiments. Considering a small set of training and development data, we also employ transfer learning on several wellknown emotional detection datasets, i.e. RAVDESS, CREMA-D, to learn advanced emotional representations that is then applied to the conversational escalation detection task. On the development set, our proposed system achieves 81.5% unweighted average recall (UAR) which significantly outperforms the baseline with 72.2% UAR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑