基于大型多模态模型的病理报告标准化及其预后意义
Large Multimodal Model based Standardisation of Pathology Reports with Confidence and their Prognostic Significance
AI总结:
本研究提出基于大型多模态模型(LMMs)的病理报告标准化方法,通过两阶段提示提取信息并生成带置信度的标准化报告,克服现有方法局限,其提取结果对患者分层有显著预后价值。
摘要:
病理报告包含丰富的临床和病理细节,但通常以自由文本格式呈现。这些报告的非结构化性质带来了重大挑战,限制了其内容的可访问性。在这项工作中,我们提出了一种基于大型多模态模型(LMMs)的实用方法,用于从病理报告的扫描图像中自动提取信息,目标是生成标准化报告,指定不同字段的值以及对提取字段准确性的估计置信度。所提出的方法克服了现有方法的局限性,现有方法未为提取字段分配置信度分数,限制了其实际应用。该框架使用大型多模态模型(LMM)的两阶段提示进行信息提取和验证。该框架可推广到多个医疗中心的文本报告以及遗留病理报告的扫描图像。我们表明,估计的置信度是提取信息准确性的有效指标,可用于仅选择准确提取的字段。我们还展示了病理报告中结构化和非结构化数据的预后意义,并表明自动提取的字段值对患者分层具有显著的预后价值。该框架可通过以下URL进行评估:https://labieb.dcs.warwick.ac.uk/。
英文摘要:
Pathology reports are rich in clinical and pathological details but are often presented in free-text format. The unstructured nature of these reports presents a significant challenge limiting the accessibility of their content. In this work, we present a practical approach based on the use of large multimodal models (LMMs) for automatically extracting information from scanned images of pathology reports with the goal of generating a standardised report specifying the value of different fields along with estimated confidence about the accuracy of the extracted fields. The proposed approach overcomes limitations of existing methods which do not assign confidence scores to extracted fields limiting their practical use. The proposed framework uses two stages of prompting a Large Multimodal Model (LMM) for information extraction and validation. The framework generalises to textual reports from multiple medical centres as well as scanned images of legacy pathology reports. We show that the estimated confidence is an effective indicator of the accuracy of the extracted information that can be used to select only accurately extracted fields. We also show the prognostic significance of structured and unstructured data from pathology reports and show that the automatically extracted field values significant prognostic value for patient stratification. The framework is available for evaluation via the URL: https://labieb.dcs.warwick.ac.uk/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。