为前线医疗对话评估语音系统:DISPLACE-M挑战
Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challenge
AI总结:
DISPLACE-M挑战通过多说话人医疗对话数据集评估语音系统,涵盖说话人分割、语音识别、主题识别和对话总结四个任务,采用DER、tcpWER和ROUGE-L进行性能评估。
摘要:
DIarization和语音处理用于语言理解在对话环境中的医疗(DISPLACE-M)挑战引入了一个对话式AI基准,用于理解以目标为导向的现实世界医疗对话。该挑战针对前线医疗工作者与患者之间的多说话者互动,其特点是自发性、嘈杂和重叠的语音。作为挑战的一部分,发布了一个包含40小时开发和15小时盲评估录音的医疗对话数据集。我们为四个任务提供了基线系统——说话人分割、自动语音识别、主题识别和对话总结,以实现一致的基准评估。系统性能使用说话人分割错误率(DER)、时间受限最小排列词错误率(tcpWER)和ROUGE-L进行评估。本文描述了第一阶段评估——数据、任务和基线系统——以及评估结果的总结。
英文摘要:
The DIarization and Speech Processing for LAnguage understanding in Conversational Environments - Medical (DISPLACE-M) challenge introduces a conversational AI benchmark for understanding goal-oriented, real-world medical dialogues. The challenge addresses multi-speaker interactions between frontline health workers and care seekers, characterized by spontaneous, noisy and overlapping speech. As part of the challenge, medical conversational dataset comprising 40 hours of development and 15 hours of blind evaluation recordings was released. We provided baseline systems across 4 tasks - speaker diarization, automatic speech recognition, topic identification and dialogue summarization - to enable consistent benchmarking. System performance is evaluated using diarization error rate (DER), time-constrained minimum-permutation word error rate (tcpWER) and ROUGE-L. This paper describes the Phase-I evaluation - data, tasks and baseline systems - along with the summary of the evaluation results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。