用于自动化临床数据标准化的大型语言模型:HL7 FHIR 用例
Large Language Models for Automating Clinical Data Standardization: HL7 FHIR Use Case
AI总结:
本文提出利用 GPT-4o 和 Llama 3.2 405b 等大型语言模型,结合嵌入、聚类与语义检索构建提示,将 MIMIC-IV 临床数据半自动转换为 HL7 FHIR 格式,验证了该方法的可行性与准确性。
摘要:
多年来,语义互操作性标准一直致力于简化临床数据的交换,然而其部署仍然耗时、资源密集且技术上具有挑战性。为了解决这一问题,我们引入了一种半自动化方法,利用大型语言模型(特别是 GPT-4o 和 Llama 3.2 405b)将结构化临床数据集转换为 HL7 FHIR 格式,同时评估准确性、可靠性和安全性。我们将该方法应用于 MIMIC-IV 数据库,结合了嵌入技术、聚类算法和语义检索来构建提示,以引导模型将每个表格字段映射到其对应的 FHIR 资源。在初始基准测试中,资源识别取得了完美的 F1-score,其中 GPT-4o 由于在提示中包含了 FHIR 资源模式而优于 Llama 3.2。在真实世界条件下,准确率略微下降至 94%,但对提示策略的改进恢复了稳健的映射。错误分析揭示了偶尔出现的对不存在属性的幻觉以及粒度上的不匹配,而更详细的提示可以缓解这些问题。总体而言,我们的研究证明了由上下文感知的、由大型语言模型驱动的临床数据转换为 HL7 FHIR 的可行性,为半自动化互操作性工作流奠定了基础。未来的工作将侧重于使用专业医学语料库对模型进行微调,扩展对 HL7 CDA 和 OMOP 等其他标准的支持,并开发一个交互式界面以实现专家验证和迭代优化。
英文摘要:
For years, semantic interoperability standards have sought to streamline the exchange of clinical data, yet their deployment remains time-consuming, resource-intensive, and technically challenging. To address this, we introduce a semi-automated approach that leverages large language models specifically GPT-4o and Llama 3.2 405b to convert structured clinical datasets into HL7 FHIR format while assessing accuracy, reliability, and security. Applying our method to the MIMIC-IV database, we combined embedding techniques, clustering algorithms, and semantic retrieval to craft prompts that guide the models in mapping each tabular field to its corresponding FHIR resource. In an initial benchmark, resource identification achieved a perfect F1-score, with GPT-4o outperforming Llama 3.2 thanks to the inclusion of FHIR resource schemas within the prompt. Under real-world conditions, accuracy dipped slightly to 94 %, but refinements to the prompting strategy restored robust mappings. Error analysis revealed occasional hallucinations of non-existent attributes and mismatches in granularity, which more detailed prompts can mitigate. Overall, our study demonstrates the feasibility of context-aware, LLM-driven transformation of clinical data into HL7 FHIR, laying the groundwork for semi-automated interoperability workflows. Future work will focus on fine-tuning models with specialized medical corpora, extending support to additional standards such as HL7 CDA and OMOP, and developing an interactive interface to enable expert validation and iterative refinement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。