MechGPT:一种基于语言的力学与材料建模策略,连接跨尺度、跨学科与跨模态的知识
MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalities
AI总结:
本文提出MechGPT,一种基于微调大语言模型的策略,用于连接跨尺度、学科和模态的力学与材料知识,通过本体知识图谱提取结构见解,支持检索增强生成和多智能体建模。
摘要:
几个世纪以来,研究人员一直在寻求连接不同知识领域的方法。虽然早期的学者(如伽利略、达·芬奇等)是跨领域的专家,但后来专业化占据了主导地位。随着人工智能的出现,我们现在可以探索跨领域(如力学-生物学)或不同领域(如失效力学-艺术)之间的关系。为实现这一目标,我们使用了一个经过微调的大型语言模型(LLM),此处针对多尺度材料失效的知识子集。该方法包括使用通用LLM从原始来源提炼问答对,随后进行LLM微调。由此产生的MechGPT LLM基础模型被用于一系列计算实验,以探索其在知识检索、各种语言任务、假设生成以及跨不同领域连接知识方面的能力。虽然该模型具有一定的从训练中回忆知识的能力,但我们发现LLM在通过本体论知识图谱提取结构性见解方面特别有用。这些可解释的图结构提供了解释性见解、新研究问题的框架以及知识的可视化表示,这些也可用于检索增强生成。本文讨论了三个版本的MechGPT,其规模从130亿到700亿参数不等,上下文长度超过10,000个标记。这为复杂的检索增强策略、基于智能体的建模(其中多个LLM协作和/或对抗性交互)、从文献或网络搜索中整合新数据以及多模态性提供了充足的能力。
英文摘要:
For centuries, researchers have sought out ways to connect disparate areas of knowledge. While early scholars (Galileo, da Vinci, etc.) were experts across fields, specialization has taken hold later. With the advent of Artificial Intelligence, we can now explore relationships across areas (e.g., mechanics-biology) or disparate domains (e.g., failure mechanics-art). To achieve this, we use a fine-tuned Large Language Model (LLM), here for a subset of knowledge in multiscale materials failure. The approach includes the use of a general-purpose LLM to distill question-answer pairs from raw sources followed by LLM fine-tuning. The resulting MechGPT LLM foundation model is used in a series of computational experiments to explore its capacity for knowledge retrieval, various language tasks, hypothesis generation, and connecting knowledge across disparate areas. While the model has some ability to recall knowledge from training, we find that LLMs are particularly useful to extract structural insights through Ontological Knowledge Graphs. These interpretable graph structures provide explanatory insights, frameworks for new research questions, and visual representations of knowledge that also can be used in retrieval-augmented generation. Three versions of MechGPT are discussed, featuring different sizes from 13 billion to 70 billion parameters, and reaching context lengths of more than 10,000 tokens. This provides ample capacity for sophisticated retrieval augmented strategies, as well as agent-based modeling where multiple LLMs interact collaboratively and/or adversarially, the incorporation of new data from the literature or web searches, as well as multimodality.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。