arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.00830cs.AIcs.CL
收藏

MedAide:利用大语言模型在边缘设备上实现本地化医疗辅助

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

National University of Sciences & Technology(国家科学技术大学)

Abdul Basit, Khizar Hussain, Muhammad Abdullah Hanif, Muhammad Shafique

AI总结:

本文提出边缘本地化医疗聊天机器人 MedAide,通过集成 LangChain 的微型 LLM、LoRA、RLHF 与模型优化,在 GPU 和 Nvidia Jetson 上实现低资源、隐私友好的初步医疗辅助。

摘要:

大语言模型(LLM)正凭借其卓越的自然语言处理(NLP)能力革新各个领域。然而,在资源受限的边缘计算和嵌入式系统中部署 LLM 面临重大挑战。另一项挑战在于,在医疗设施和基础设施有限的偏远地区提供医疗辅助。为解决这些问题,我们提出 MedAide,这是一个本地化医疗聊天机器人。它利用与 LangChain 集成的微型 LLM,在边缘设备上提供高效的初步医疗诊断与支持。MedAide 采用模型优化,在没有服务器基础设施的嵌入式边缘设备上实现最小内存占用和最低延迟。训练过程通过低秩适配(LoRA)进行优化。此外,模型在多样化的医疗数据集上训练,并采用基于人类反馈的强化学习(RLHF)增强其领域专用能力。该系统在多种消费级 GPU 和 Nvidia Jetson 开发板上实现。MedAide 在医疗咨询中达到 77% 的准确率,并在 USMLE 基准测试中取得 56 分,形成一个节能的医疗辅助平台;由于采用边缘部署,该平台缓解了隐私担忧,从而为社区赋能。

英文摘要:

Large language models (LLMs) are revolutionizing various domains with their remarkable natural language processing (NLP) abilities. However, deploying LLMs in resource-constrained edge computing and embedded systems presents significant challenges. Another challenge lies in delivering medical assistance in remote areas with limited healthcare facilities and infrastructure. To address this, we introduce MedAide, an on-premise healthcare chatbot. It leverages tiny-LLMs integrated with LangChain, providing efficient edge-based preliminary medical diagnostics and support. MedAide employs model optimizations for minimal memory footprint and latency on embedded edge devices without server infrastructure. The training process is optimized using low-rank adaptation (LoRA). Additionally, the model is trained on diverse medical datasets, employing reinforcement learning from human feedback (RLHF) to enhance its domain-specific capabilities. The system is implemented on various consumer GPUs and Nvidia Jetson development board. MedAide achieves 77\% accuracy in medical consultations and scores 56 in USMLE benchmark, enabling an energy-efficient healthcare assistance platform that alleviates privacy concerns due to edge-based deployment, thereby empowering the community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑