arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.06208eess.AScs.CLcs.SD
收藏

标准化痴呆筛查测试的自动化评估

Automated Evaluation of Standardized Dementia Screening Tests

Franziska Braun, Markus Förstel, Bastian Oppermann, Andreas Erzigkeit, Thomas Hillemacher, Hartmut Lehfeld, Korbinian Riedhammer

AI总结:

本文研究了标准化痴呆筛查测试的自动化评分方法,通过分析手动和自动转录本的评分相关性,发现自动评分在某些任务上比人工评分更严格,但整体仍保持高相关性。

摘要:

在痴呆筛查和监测中,标准化测试在临床实践中起关键作用,因为它们旨在通过测量多种认知任务的表现来最小化主观性。本文报告了一项研究,该研究包括一个半标准化的病史采集,随后是两种标准化的神经心理学测试,即SKT和CERAD-NB。这些测试包括命名物体、学习词列表等基本任务,以及广泛使用的工具如MMSE。大多数任务是口头进行的,因此应适合基于转录文本的自动化评分。对于前30名患者的第一批,我们分析了专家手动评分与基于手动和自动转录的自动评分之间的相关性。对于SKT和CERAD-NB,我们观察到使用手动转录本时的高到完美相关性;对于某些相关性较低的任务,自动评分比人类参考更严格,因为其仅限于音频。使用自动转录本时,相关性下降如预期,与识别准确性相关;然而,我们仍观察到高达0.98(SKT)和0.85(CERAD-NB)的高相关性。我们证明使用词替代可以缓解识别错误,从而提高与专家评分的相关性。

英文摘要:

For dementia screening and monitoring, standardized tests play a key role in clinical routine since they aim at minimizing subjectivity by measuring performance on a variety of cognitive tasks. In this paper, we report on a study that consists of a semi-standardized history taking followed by two standardized neuropsychological tests, namely the SKT and the CERAD-NB. The tests include basic tasks such as naming objects, learning word lists, but also widely used tools such as the MMSE. Most of the tasks are performed verbally and should thus be suitable for automated scoring based on transcripts. For the first batch of 30 patients, we analyze the correlation between expert manual evaluations and automatic evaluations based on manual and automatic transcriptions. For both SKT and CERAD-NB, we observe high to perfect correlations using manual transcripts; for certain tasks with lower correlation, the automatic scoring is stricter than the human reference since it is limited to the audio. Using automatic transcriptions, correlations drop as expected and are related to recognition accuracy; however, we still observe high correlations of up to 0.98 (SKT) and 0.85 (CERAD-NB). We show that using word alternatives helps to mitigate recognition errors and subsequently improves correlation with expert scores.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑