arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.12880cs.CL
收藏

语音中的自闭症检测——一项综述

Autism Detection in Speech -- A Survey

University of Applied Sciences(应用技术大学);Darmstadt(达姆施塔特)

Nadine Probol, Margot Mieskes

AI总结:

本文综述了利用语音、语言和声学线索检测自闭症的多领域研究,指出女性患者研究不足、NLP方法偏传统机器学习且缺乏音频与文本特征融合研究。

摘要:

已有大量研究探讨自闭症如何在语音、言语和语言中表现出来。我们分析了来自生物医学领域、心理学领域以及自然语言处理(NLP)领域的研究,以寻找可能指示自闭症的语言、韵律和声学线索。本综述覆盖全部三个领域。我们定义了自闭症,并指出哪些共病可能影响对该障碍的正确检测。我们特别关注言语流畅性和语义流畅性、韵律特征,以及不流利现象和语速等观察指标。我们还展示了基于词的方法,并描述了同时作用于音频数据和转写文本的机器学习方法以及基于Transformer的方法。最后,我们得出结论:尽管已有大量研究,但女性患者似乎严重缺乏研究。此外,大多数NLP研究侧重于传统机器学习方法,而非在此情境下可能更有益的Transformer方法。另外,我们未能找到同时结合音频特征和转写文本特征的研究。

英文摘要:

There has been a range of studies of how autism is displayed in voice, speech, and language. We analyse studies from the biomedical, as well as the psychological domain, but also from the NLP domain in order to find linguistic, prosodic and acoustic cues that could indicate autism. Our survey looks at all three domains. We define autism and which comorbidities might influence the correct detection of the disorder. We especially look at observations such as verbal and semantic fluency, prosodic features, but also disfluencies and speaking rate. We also show word-based approaches and describe machine learning and transformer-based approaches both on the audio data as well as the transcripts. Lastly, we conclude, while there already is a lot of research, female patients seem to be severely under-researched. Also, most NLP research focuses on traditional machine learning methods instead of transformers which could be beneficial in this context. Additionally, we were unable to find research combining both features from audio and transcripts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑