arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.11953cond-mat.mtrl-scics.LG
收藏

Crystal Transformer:用于材料创成修补设计的自学习神经语言模型

Crystal Transformer: Self-learning neural language model for Generative and Tinkering Design of Materials

University of South Carolina(南卡罗来纳大学)

Lai Wei, Qinyang Li, Yuqi Song, Stanislav Stefanov, Edirisuriya M. D. Siriwardane, Fanglin Chen, Jianjun Hu

摘要:

自监督神经语言模型最近取得了前所未有的成功,从自然语言处理到学习生物序列和有机分子的语言。这些模型在蛋白质和分子的生成、结构分类和功能预测方面表现出优异的性能。然而,大多数基于掩蔽的预训练语言模型并不是为生成设计而设计的,它们的黑盒性质使得很难解释它们的设计逻辑。在这里,我们提出了BLMM晶体Transformer,基于神经网络的概率生成模型的生成和修补设计的无机材料。我们的模型建立在用于文本生成的空白填充语言模型上,在学习“材料语法”以及高质量的生成,可解释性和数据效率方面表现出独特的优势。它可以产生化学有效的材料组合物,具有高达89.7%的电中性和84.8%的平衡电负性,与伪随机采样基线相比,这是4倍和8倍以上。BLMM的概率生成过程允许它根据所学的材料化学推荐修补操作,并使其对材料掺杂有用。结合TCSP晶体结构预测算法,我们应用我们的模型发现了一组新材料,并通过DFT计算进行了验证。因此,我们的工作带来了无监督的Transformer语言模型为基础的生成人工智能的无机材料。已经为计算材料掺杂开发了一个用户友好的网络应用程序,可以在\url{www.materialsatlas.org/blmtinker}上免费访问。

英文摘要:

Self-supervised neural language models have recently achieved unprecedented success, from natural language processing to learning the languages of biological sequences and organic molecules. These models have demonstrated superior performance in the generation, structure classification, and functional predictions for proteins and molecules with learned representations. However, most of the masking-based pre-trained language models are not designed for generative design, and their black-box nature makes it difficult to interpret their design logic. Here we propose BLMM Crystal Transformer, a neural network based probabilistic generative model for generative and tinkering design of inorganic materials. Our model is built on the blank filling language model for text generation and has demonstrated unique advantages in learning the "materials grammars" together with high-quality generation, interpretability, and data efficiency. It can generate chemically valid materials compositions with as high as 89.7\% charge neutrality and 84.8\% balanced electronegativity, which are more than 4 and 8 times higher compared to a pseudo random sampling baseline. The probabilistic generation process of BLMM allows it to recommend tinkering operations based on learned materials chemistry and makes it useful for materials doping. Combined with the TCSP crysal structure prediction algorithm, We have applied our model to discover a set of new materials as validated using DFT calculations. Our work thus brings the unsupervised transformer language models based generative artificial intelligence to inorganic materials. A user-friendly web app has been developed for computational materials doping and can be accessed freely at \url{www.materialsatlas.org/blmtinker}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑