arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.06852cs.AIcs.CL
收藏

ChemLLM:一个化学领域的大型语言模型

ChemLLM: A Chemical Large Language Model

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Fudan University(复旦大学);Shanghai Jiao Tong University(上海交通大学);Wuhan University(武汉大学);The Hong Kong Polytechnic University(香港理工大学);The Chinese University of Hong Kong(香港中文大学)
Di Zhang, Wei Liu, Qian Tan, Jingdan Chen, Hang Yan, Yuliang Yan, Jiatong Li, Weiran Huang, Xiangyu Yue, Wanli Ouyang, Dongzhan Zhou, Shufei Zhang, Mao Su, Han-… 展开作者

Di Zhang, Wei Liu, Qian Tan, Jingdan Chen, Hang Yan, Yuliang Yan, Jiatong Li, Weiran Huang, Xiangyu Yue, Wanli Ouyang, Dongzhan Zhou, Shufei Zhang, Mao Su, Han-Sen Zhong, Yuqiang Li

AI总结:

本文提出ChemLLM框架,包含首个化学专用LLM、指令微调数据集ChemData和覆盖九项任务的基准ChemBench,在核心化学任务上达到GPT-4水平,为科学领域LLM开发树立新标准。

摘要:

大型语言模型(LLMs)在化学应用中取得了令人瞩目的进展。然而,该领域缺乏专门针对化学设计的LLM。主要挑战有两方面:首先,大多数化学数据和科学知识存储在结构化数据库中,这限制了模型在直接使用时维持连贯对话的能力。其次,缺乏涵盖大多数化学任务的客观公正的基准。在此,我们介绍了ChemLLM,这是一个综合性框架,包含首个专门用于化学的LLM。它还包括专门为指令微调设计的ChemData数据集,以及覆盖九项基本化学任务的稳健基准ChemBench。ChemLLM能够通过流畅的对话交互执行跨化学学科的各种任务。值得注意的是,ChemLLM在核心化学任务上取得了与GPT-4相当的结果,并在通用场景中展示了与相似规模LLMs相媲美的性能。ChemLLM为化学研究开辟了新路径,我们将结构化化学知识融入对话系统的方法为各科学领域开发LLM树立了新标准。代码、数据集和模型权重可在https://hf.co/AI4Chem公开获取

英文摘要:

Large language models (LLMs) have made impressive progress in chemistry applications. However, the community lacks an LLM specifically designed for chemistry. The main challenges are two-fold: firstly, most chemical data and scientific knowledge are stored in structured databases, which limits the model's ability to sustain coherent dialogue when used directly. Secondly, there is an absence of objective and fair benchmark that encompass most chemistry tasks. Here, we introduce ChemLLM, a comprehensive framework that features the first LLM dedicated to chemistry. It also includes ChemData, a dataset specifically designed for instruction tuning, and ChemBench, a robust benchmark covering nine essential chemistry tasks. ChemLLM is adept at performing various tasks across chemical disciplines with fluid dialogue interaction. Notably, ChemLLM achieves results comparable to GPT-4 on the core chemical tasks and demonstrates competitive performance with LLMs of similar size in general scenarios. ChemLLM paves a new path for exploration in chemical studies, and our method of incorporating structured chemical knowledge into dialogue systems sets a new standard for developing LLMs in various scientific fields. Codes, Datasets, and Model weights are publicly accessible at https://hf.co/AI4Chem

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑