arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.02428cs.LGcond-mat.mtrl-sci
收藏

EGraFFBench:用于原子模拟的等变图神经网络力场评估

EGraFFBench: Evaluation of Equivariant Graph Neural Network Force Fields for Atomistic Simulations

Indian Institute of Technology Delhi(印度理工学院德里分校);Aalborg University(奥尔堡大学);Intel Labs(英特尔实验室);Sorbonne University(索邦大学)

Vaibhav Bihani, Utkarsh Pratiush, Sajid Mannan, Tao Du, Zhimin Chen, Santiago Miret, Matthieu Micoulaut, Morten M Smedskjaer, Sayan Ranu, N M Anoop Krishnan

AI总结:

本文系统评估了6种等变图神经网络力场在原子模拟中的表现,发布了新数据集、指标和任务,发现低误差不等于模拟稳定且模型在分布外数据上表现不可靠,指出了开发力场基础模型的必要性。

摘要:

等变图神经网络力场(EGraFFs)通过利用图固有的对称性,在建模原子系统中的复杂相互作用方面展现出了巨大潜力。近期的研究推动了新型架构的激增,这些架构将基于等变的归纳偏置与图变换器和消息传递等架构创新相结合,以建模原子相互作用。然而,对于将这些 EGraFFs 部署到真实世界原子模拟这一下游任务,仍缺乏彻底的评估。为此,我们对 6 种 EGraFF 算法(NequIP、Allegro、BOTNet、MACE、Equiformer、TorchMDNet)进行了系统基准测试,旨在理解它们在现实原子模拟中的能力与局限。除了在基于基准测试文献的 8 个现有数据集上进行彻底评估和分析外,我们还发布了 2 个新基准数据集,提出了 4 个新指标和 3 项具挑战性的任务。新数据集和任务从不同晶体结构、温度和新分子的角度,评估了 EGraFF 在分布外数据上的性能。有趣的是,基于动态模拟的 EGraFF 模型评估表明,能量或力上具有较低误差并不能保证模拟稳定、可靠或忠实复现原子结构。此外,我们发现没有模型在所有数据集和任务上明显优于其他模型。重要的是,我们表明所有模型在分布外数据集上的性能均不可靠,这表明需要开发可用于真实世界模拟的力场基础模型。总之,本工作建立了一个在原子模拟背景下评估机器学习力场的严格框架,并指出了该领域内的开放研究挑战。

英文摘要:

Equivariant graph neural networks force fields (EGraFFs) have shown great promise in modelling complex interactions in atomic systems by exploiting the graphs' inherent symmetries. Recent works have led to a surge in the development of novel architectures that incorporate equivariance-based inductive biases alongside architectural innovations like graph transformers and message passing to model atomic interactions. However, thorough evaluations of these deploying EGraFFs for the downstream task of real-world atomistic simulations, is lacking. To this end, here we perform a systematic benchmarking of 6 EGraFF algorithms (NequIP, Allegro, BOTNet, MACE, Equiformer, TorchMDNet), with the aim of understanding their capabilities and limitations for realistic atomistic simulations. In addition to our thorough evaluation and analysis on eight existing datasets based on the benchmarking literature, we release two new benchmark datasets, propose four new metrics, and three challenging tasks. The new datasets and tasks evaluate the performance of EGraFF to out-of-distribution data, in terms of different crystal structures, temperatures, and new molecules. Interestingly, evaluation of the EGraFF models based on dynamic simulations reveals that having a lower error on energy or force does not guarantee stable or reliable simulation or faithful replication of the atomic structures. Moreover, we find that no model clearly outperforms other models on all datasets and tasks. Importantly, we show that the performance of all the models on out-of-distribution datasets is unreliable, pointing to the need for the development of a foundation model for force fields that can be used in real-world simulations. In summary, this work establishes a rigorous framework for evaluating machine learning force fields in the context of atomic simulations and points to open research challenges within this domain.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑