OncoGPT:基于大型语言模型 Meta-AI(LLaMA)并具备肿瘤学领域专业知识的医学对话模型
OncoGPT: A Medical Conversational Model Tailored with Oncology Domain Expertise on a Large Language Model Meta-AI (LLaMA)
AI总结:
本文提出 OncoGPT,通过收集 180K+ 条肿瘤学医患对话并对 LLaMA 进行迭代微调,构建了在肿瘤学咨询方面准确性和可靠性更高的专用医学对话模型,并公开了数据集与模型。
摘要:
在过去一年中,将大型语言模型(LLMs)应用于医学领域的趋势日益增长,尤其是随着 OpenAI 开发的 ChatGPT 等先进语言模型的出现。然而,专门针对肿瘤学相关问题的 LLMs 研究仍然有限。本研究的主要目标是开发一种专用语言模型,在提供肿瘤学相关建议方面表现出更高的准确性。我们从可靠的医患平台收集了以肿瘤学为中心的大规模在线问答交互数据。经过数据清洗和匿名化处理后,建立了一个包含超过 180K+ 条肿瘤学相关对话的数据集。这些对话由领域专家和临床医生进行分类和细致审查,以确保准确性。我们采用 LLaMA 模型和其他选定的开源数据集,进行了迭代微调,以增强模型在基础医学对话和专门肿瘤学知识方面的能力。我们观察到,通过在微调过程中利用真实的在线问答交互,模型对真实患者问题的理解能力以及在提供肿瘤学相关建议方面的可靠性得到了显著提升。我们向研究社区发布了数据库和模型(https://github.com/OncoGPT1)。
英文摘要:
In the past year, there has been a growing trend in applying Large Language Models (LLMs) to the field of medicine, particularly with the advent of advanced language models such as ChatGPT developed by OpenAI. However, there is limited research on LLMs specifically addressing oncology-related queries. The primary aim of this research was to develop a specialized language model that demonstrates improved accuracy in providing advice related to oncology. We performed an extensive data collection of online question-answer interactions centered around oncology, sourced from reputable doctor-patient platforms. Following data cleaning and anonymization, a dataset comprising over 180K+ oncology-related conversations was established. The conversations were categorized and meticulously reviewed by field specialists and clinicians to ensure precision. Employing the LLaMA model and other selected open-source datasets, we conducted iterative fine-tuning to enhance the model's proficiency in basic medical conversation and specialized oncology knowledge. We observed a substantial enhancement in the model's understanding of genuine patient inquiries and its reliability in offering oncology-related advice through the utilization of real online question-answer interactions in the fine-tuning process. We release database and models to the research community (https://github.com/OncoGPT1).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。