放射科医师语义对话系统的设计与实现
Design and Implementation of a Semantic Dialogue System for Radiologists
摘要:
本章描述了一个语义对话系统的放射科医生在一个全面的案例研究内的大型MEDICO项目。MEDICO解决了在搜索医学图像和患者数据时对高级语义技术的需求。目标是,第一,通过提供对图像语义的直接存取来实现医学图像和不同用户应用的无缝集成,第二,为放射科医师设计和实现多模态对话外壳。基于语音的医学图像语义检索和标注为临床决策支持和计算机辅助诊断提供了基础。我们将描述临床工作流程和交互要求,并专注于设计和实施的多模态用户界面的患者/图像搜索或注释及其实施,同时使用基于语音的对话外壳。本体建模为对话外壳和特定医疗应用领域中的知识表示提供了主干;本体结构是我们的组合语义搜索和检索架构的通信基础,其中包括MEDICO服务器、三元组存储、语义搜索API、医疗可视化工具包MITK和基于语音的对话外壳等。我们将专注于多模式应用程序的可用性方面,我们的故事板和实现语音和触摸屏交互设计。
英文摘要:
This chapter describes a semantic dialogue system for radiologists in a comprehensive case study within the large-scale MEDICO project. MEDICO addresses the need for advanced semantic technologies in the search for medical image and patient data. The objectives are, first, to enable a seamless integration of medical images and different user applications by providing direct access to image semantics, and second, to design and implement a multimodal dialogue shell for the radiologist. Speech-based semantic image retrieval and annotation of medical images should provide the basis for help in clinical decision support and computer aided diagnosis. We will describe the clinical workflow and interaction requirements and focus on the design and implementation of a multimodal user interface for patient/image search or annotation and its implementation while using a speech-based dialogue shell. Ontology modeling provides the backbone for knowledge representation in the dialogue shell and the specific medical application domain; ontology structures are the communication basis of our combined semantic search and retrieval architecture which includes the MEDICO server, the triple store, the semantic search API, the medical visualization toolkit MITK, and the speech-based dialogue shell, amongst others. We will focus on usability aspects of multimodal applications, our storyboard and the implemented speech and touchscreen interaction design.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。