arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.12283cond-mat.mtrl-scics.LG
收藏

用于高性能材料性能预测的可扩展深度图神经网络

Scalable deeper graph neural networks for high-performance materials property prediction

University of South Carolina(南卡罗来纳大学);Department of Computer Science and Engineering(计算机科学与工程系)

Sadman Sadeed Omee, Steph-Yves Louis, Nihang Fu, Lai Wei, Sourin Dey, Rongzhi Dong, Qinyang Li, Jianjun Hu

摘要:

基于机器学习(ML)的材料发现已经成为材料科学突破的最有前途的方法之一。虽然基于启发式知识的描述符已经与ML算法相结合以实现良好的性能,但物理化学机制的复杂性使得迫切需要利用从成分或结构中进行表示学习来构建高效的材料机器学习模型。在这些方法中,图神经网络表现出最好的性能,它能够从晶体结构中学习高级特征。然而,由于其消息传递GNN架构的过度平滑问题,所有这些模型都无法扩展模型。在这里,我们提出了一种新的图注意力神经网络模型DeeperGATGNN,具有可微组规范化和跳过连接,它允许训练非常深的图神经网络模型(例如,30层,而以前的作品中为3-9层)。通过对能量和带隙预测的六个基准数据集进行系统的基准研究,我们表明,我们的可扩展DeeperGATGNN模型对于不同的数据集几乎不需要昂贵的超参数调整,并且在六个属性中的五个属性上实现了最先进的预测性能,提高了10%。我们的工作表明,为了处理将晶体材料结构映射到其属性的高度复杂性,需要大规模的非常深的图神经网络来实现鲁棒的性能。

英文摘要:

Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good performance, the complexity of the physicochemical mechanisms makes it urgently needed to exploit representation learning from either compositions or structures for building highly effective materials machine learning models. Among these methods, the graph neural networks have shown the best performance by its capability to learn high-level features from crystal structures. However, all these models suffer from their inability to scale up the models due to the over-smoothing issue of their message-passing GNN architecture. Here we propose a novel graph attention neural network model DeeperGATGNN with differentiable group normalization and skip-connections, which allows to train very deep graph neural network models (e.g. 30 layers compared to 3-9 layers in previous works). Through systematic benchmark studies over six benchmark datasets for energy and band gap predictions, we show that our scalable DeeperGATGNN model needs little costly hyper-parameter tuning for different datasets and achieves the state-of-the-art prediction performances over five properties out of six with up to 10\% improvement. Our work shows that to deal with the high complexity of mapping the crystal materials structures to their properties, large-scale very deep graph neural networks are needed to achieve robust performances.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑