arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.09391cs.AIcs.CEcs.CL
收藏

LlaSMol:借助大规模、全面、高质量的指令微调数据集推进化学领域大语言模型研究

LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset

The Ohio State University(俄亥俄州立大学)

Botao Yu, Frazier N. Baker, Ziqi Chen, Xia Ning, Huan Sun

AI总结:

本研究针对现有大语言模型化学任务表现不佳的问题,构建了含14类任务、超300万样本的高质量指令微调数据集SMolInstruct,微调后Mistral基模型效果远超GPT-4等模型,证明了该数据集的关键价值。

摘要:

化学在药物研发、材料科学等诸多领域发挥着关键作用。尽管GPT-4等大语言模型(LLM)在自然语言处理任务上展现出卓越能力,但现有研究表明其在化学任务上的表现低得令人沮丧。然而在本文中,我们证明所开发的LLM能在一系列全面的化学任务上取得极强结果,大幅领先最先进的GPT-4和Claude 3 Opus。为实现这一目标,我们提出SMolInstruct——一个大规模、全面、高质量的指令微调数据集。它包含14项精选化学任务和超300万个样本,为化学领域LLM的训练与评估奠定了坚实基础。我们利用SMolInstruct微调了一组开源LLM,其中发现Mistral是化学任务的最佳基础模型。我们的分析进一步证实了该数据集对推动性能提升的关键作用。

英文摘要:

Chemistry plays a crucial role in many domains, such as drug discovery and material science. While large language models (LLMs) such as GPT-4 exhibit remarkable capabilities on natural language processing tasks, existing research indicates that their performance on chemistry tasks is discouragingly low. In this paper, however, we demonstrate that our developed LLMs can achieve very strong results on a comprehensive set of chemistry tasks, outperforming the most advanced GPT-4 and Claude 3 Opus by a substantial margin. To accomplish this, we propose SMolInstruct, a large-scale, comprehensive, and high-quality dataset for instruction tuning. It contains 14 selected chemistry tasks and over three million samples, laying a solid foundation for training and evaluating LLMs for chemistry. Using SMolInstruct, we fine-tune a set of open-source LLMs, among which, we find that Mistral serves as the best base model for chemistry tasks. Our analysis further demonstrates the critical role of the proposed dataset in driving the performance improvements.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑