用于增强医疗应用中LLM执行的动态雾计算
Dynamic Fog Computing for Enhanced LLM Execution in Medical Applications
AI总结:
针对医疗领域云侧LLM存在的隐私风险与成本问题,提出基于动态雾计算的去中心化LLM执行方案,并推出开源框架SpeziLLM,可在多类数字健康应用中实现LLM的低成本可信部署。
摘要:
大语言模型(LLM)具备转化、解读和理解海量异构数据的能力,为提升数据驱动的医疗服务交付提供了重要机遇。然而,受保护健康信息(PHI)的敏感属性引发了人们对远程LLM平台中数据隐私与信任问题的合理担忧。此外,基于云的人工智能(AI)服务相关成本仍在阻碍其广泛应用。为应对这些挑战,我们提出将LLM的执行环境从不透明的中心化云提供商转向去中心化的动态雾计算架构。通过在更可信的环境(如用户的边缘设备或局域网内的雾层)中运行开源权重LLM,我们旨在缓解基于云的LLM所涉及的隐私、信任与成本挑战。我们进一步提出了SpeziLLM,这是一款开源框架,旨在助力快速、无缝地利用不同的LLM执行层,降低数字健康应用中集成LLM的门槛。我们在6款数字健康应用中验证了SpeziLLM的广泛适用性,展现了其在各类医疗场景中的通用性。
英文摘要:
The ability of large language models (LLMs) to transform, interpret, and comprehend vast quantities of heterogeneous data presents a significant opportunity to enhance data-driven care delivery. However, the sensitive nature of protected health information (PHI) raises valid concerns about data privacy and trust in remote LLM platforms. In addition, the cost associated with cloud-based artificial intelligence (AI) services continues to impede widespread adoption. To address these challenges, we propose a shift in the LLM execution environment from opaque, centralized cloud providers to a decentralized and dynamic fog computing architecture. By executing open-weight LLMs in more trusted environments, such as the user's edge device or a fog layer within a local network, we aim to mitigate the privacy, trust, and financial challenges associated with cloud-based LLMs. We further present SpeziLLM, an open-source framework designed to facilitate rapid and seamless leveraging of different LLM execution layers and lowering barriers to LLM integration in digital health applications. We demonstrate SpeziLLM's broad applicability across six digital health applications, showcasing its versatility in various healthcare settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。