arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.04700eess.ASeess.IV
收藏

OLSA矩阵句子测试录像的开发和评价

Development and Evaluation of Video Recordings for the OLSA Matrix Sentence Test

Gerard Llorach, Frederike Kirschner, Giso Grimm, Melanie A. Zokoll, Kirsten C. Wagener, Volker Hohmann

摘要:

语言可懂度测试的一种已建立的多语言方法是矩阵句子测试(MST)。这个测试的大多数版本都是用纯音频刺激设计的。然而,视觉线索在语音可懂度中起着重要作用,主要是通过语音阅读更容易理解语音。在这项工作中,我们提出了创建和评价配音视频奥尔登堡女性MST(OLSA)。28名听力正常的参与者完成了测试和重新测试,条件包括音频和视觉模式,安静和噪音中的讲话,以及开放和封闭的反应格式。针对不同的条件,自适应地测量了达到80%句子可懂度的水平。在安静的情况下,与仅音频相比,视听效益在声压级(SPL)上为7 dB。在噪声中,视听效益为5 dB的信噪比(SNR)。在仅视觉句子中,语读得分从0%到84%不等,参与者的平均得分为50%。语音阅读能力的这种巨大变化反映在视听语音接收阈值(SRT)中,其标准差比仅音频SRT更大。视听句子的训练和学习效果被发现:参与者在5次试验后提高了大约3 dB SNR的SRT。参与者在单独的复试中保持了最好的成绩,并进一步提高了他们的SRT约。-1.5分贝。

英文摘要:

One of the established multi-lingual methods for testing speech intelligibility is the matrix sentence test (MST). Most versions of this test are designed with audio-only stimuli. Nevertheless, visual cues play an important role in speech intelligibility, mostly making it easier to understand speech by speechreading. In this work we present the creation and evaluation of dubbed videos for the Oldenburger female MST (OLSA). 28 normal-hearing participants completed test and retest sessions with conditions including audio and visual modalities, speech in quiet and noise, and open and closed-set response formats. The levels to reach 80% sentence intelligibility were measured adaptively for the different conditions. In quiet, the audiovisual benefit compared to audio-only was 7 dB in sound pressure level (SPL). In noise, the audiovisual benefit was 5 dB in signal-to-noise ratio (SNR). Speechreading scores ranged from 0% to 84% speech reception in visual-only sentences, with an average of 50% across participants. This large variability in speechreading abilities was reflected in the audiovisual speech reception thresholds (SRTs), which had a larger standard deviation than the audio-only SRTs. Training and learning effects in audiovisual sentences were found: participants improved their SRTs by approximately 3 dB SNR after 5 trials. Participants retained their best scores on a separate retest session and further improved their SRTs by approx. -1.5 dB.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑