FormuLLA:一种用于生成新型3D打印配方的大型语言模型方法
FormuLLA: A Large Language Model Approach to Generating Novel 3D Printable Formulations
AI总结:
本文提出FormuLLA方法,利用微调后的大型语言模型推荐3D打印配方的辅料并预测丝材机械性能,揭示了模型选择和参数对性能的影响,指出小模型易遗忘及标准指标无法评估配方可加工性。
摘要:
制药三维(3D)打印是一种先进的制造技术,有潜力实现真正个性化剂量形式。最近的研究将人工智能(AI)整合到配方和过程开发中,大大改变了制药3D打印的现状。到目前为止,大多数AI驱动的努力仍然狭隘聚焦,未能考虑该技术固有的配方挑战。最近的AI进展引入了人工通用智能概念,其中系统超越传统预测建模,向更通用、类人推理发展。在本文中,我们研究了在包含超过1400种配方的熔融沉积建模(FDM)数据集上微调的大型语言模型(LLMs),以根据活性药物成分(API)剂量推荐合适的辅料,并预测丝材的机械性能。四种LLM架构进行了微调,系统评估了微调和生成参数配置。我们的结果表明,Llama2最适合推荐FDM配方的辅料。此外,模型选择和参数化显著影响性能,较小的LLM表现出灾难性遗忘。此外,我们证明:(i)即使使用超过1400种配方的相对较小数据集,也可能导致模型灾难性遗忘;(ii)标准LLM指标仅评估语言性能,而不评估配方可加工性;(iii)训练于生物医学相关数据的LLM并不总是产生最佳结果。解决这些挑战对于推动LLM超越语言能力,向可靠的制药配方开发系统迈进至关重要。
英文摘要:
Pharmaceutical three-dimensional (3D) printing is an advanced fabrication technology with the potential to enable truly personalised dosage forms. Recent studies have integrated artificial intelligence (AI) to accelerate formulation and process development, drastically transforming current approaches to pharmaceutical 3D printing. To date, most AI-driven efforts remain narrowly focused, while failing to account for the broader formulation challenges inherent to the technology. Recent advances in AI have introduced artificial general intelligence concepts, wherein systems extend beyond conventional predictive modelling toward more generalised, human-like reasoning. In this work, we investigate the application of large language models (LLMs), fine-tuned on a fused deposition modelling (FDM) dataset comprising over 1400 formulations, to recommend suitable excipients based on active pharmaceutical ingredient (API) dose, and predict filament mechanical properties. Four LLM architectures were fine-tuned, with systematic evaluation of both fine-tuning and generative parameter configurations. Our results demonstrate that Llama2 was best suited for recommending excipients for FDM formulations. Additionally, model selection and parameterisation significantly influence performance, with smaller LLMs exhibiting instances of catastrophic forgetting. Furthermore, we demonstrate: (i) even with relatively small dataset of over 1400 formulations, it can lead to model catastrophic forgetting; (ii) standard LLM metrics only evaluate linguistic performance but not formulation processability; and (iii) LLMs trained on biomedically-related data do not always produce the best results. Addressing these challenges is essential to advancing LLMs beyond linguistic proficiency and toward reliable systems for pharmaceutical formulation development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。