arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.13458cs.CL
收藏

MedINST:生物医学指令元数据集

MedINST: Meta Dataset of Biomedical Instructions

Eindhoven University of Technology(埃因霍温理工大学);University of Liverpool(利物浦大学);University of Technology Sydney(悉尼科技大学);Yale University(耶鲁大学)

Wenhan Han, Meng Fang, Zihan Zhang, Yu Yin, Zirui Song, Ling Chen, Mykola Pechenizkiy, Qingyu Chen

AI总结:

本文提出包含133个生物医学NLP任务和超700万样本的指令元数据集MedINST,并基于其构建基准MedINST32,通过微调多个大语言模型验证了跨任务泛化能力的提升。

摘要:

大语言模型(LLM)技术在医学分析领域的整合带来了显著进展,但大规模、多样化且标注良好的数据集稀缺仍然是一个重大挑战。医学数据和任务在格式、规模及其他参数上各不相同,需要大量的预处理和标准化工作才能有效用于训练LLM。为应对这些挑战,我们提出了MedINST,即生物医学指令元数据集(Meta Dataset of Biomedical Instructions),这是一个新颖的多领域、多任务指令元数据集。MedINST包含133个生物医学NLP任务和超过700万个训练样本,使其成为迄今为止最全面的生物医学指令数据集。以MedINST作为元数据集,我们构建了MedINST32,这是一个具有不同任务难度的挑战性基准,旨在评估LLM的泛化能力。我们在MedINST上对多个LLM进行微调,并在MedINST32上进行评估,展示了增强的跨任务泛化能力。

英文摘要:

The integration of large language model (LLM) techniques in the field of medical analysis has brought about significant advancements, yet the scarcity of large, diverse, and well-annotated datasets remains a major challenge. Medical data and tasks, which vary in format, size, and other parameters, require extensive preprocessing and standardization for effective use in training LLMs. To address these challenges, we introduce MedINST, the Meta Dataset of Biomedical Instructions, a novel multi-domain, multi-task instructional meta-dataset. MedINST comprises 133 biomedical NLP tasks and over 7 million training samples, making it the most comprehensive biomedical instruction dataset to date. Using MedINST as the meta dataset, we curate MedINST32, a challenging benchmark with different task difficulties aiming to evaluate LLMs' generalization ability. We fine-tune several LLMs on MedINST and evaluate on MedINST32, showcasing enhanced cross-task generalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑