基于熵的材料性质图神经网络代理模型主动学习
Entropy-based Active Learning of Graph Neural Network Surrogate Models for Materials Properties
AI总结:
针对材料科学中标记数据稀缺昂贵的问题,提出耦合图神经网络与高斯过程的方案以提供预测置信度,基于此的主动学习可使模型性能提升速度较随机选择翻倍,拓展图神经网络的应用场景。
摘要:
在实验或计算数据上训练的图神经网络正日益成为计算材料科学中的重要工具。网络一旦训练完成,就能以远低于实验或精度相当的第一性原理计算的成本,做出高度准确的预测。然而,这些网络通常依赖大型标记实验数据库来训练模型。在数据稀缺或获取成本高昂的场景中,这一要求可能令人望而却步。\n通过构建一个能为预测性质提供置信度的神经网络,我们得以开发出一种主动学习方案,该方案能识别化学空间中模型不确定性最高的区域,从而减少所需的标记数据量。我们提出了一种将图神经网络与高斯过程耦合的方案,用于对固态材料进行特征提取并预测性质,同时包含预测置信度的度量。\n随后我们证明,该方案可用于主动学习场景,通过选择获取数据标签的最优下一个实验,加快模型的训练速度。与随机选择下一个样本相比,我们的主动学习方案能使模型在测试数据集上的性能随新增数据提升的速度提高一倍。这种不确定性量化与主动学习方法,有望让图神经网络的变革性力量应用于数据稀缺且获取成本高昂的材料科学新领域。
英文摘要:
Graph neural networks, trained on experimental or calculated data are becoming an increasingly important tool in computational materials science. Networks, once trained, are able to make highly accurate predictions at a fraction of the cost of experiments or first-principles calculations of comparable accuracy. However these networks typically rely on large databases of labelled experiments to train the model. In scenarios where data is scarce or expensive to obtain this can be prohibitive. By building a neural network that provides a confidence on the predicted properties, we are able to develop an active learning scheme that can reduce the amount of labelled data required, by identifying the areas of chemical space where the model is most uncertain. We present a scheme for coupling a graph neural network with a Gaussian process to featurise solid-state materials and predict properties \textit{including} a measure of confidence in the prediction. We then demonstrate that this scheme can be used in an active learning context to speed up the training of the model, by selecting the optimal next experiment for obtaining a data label. Our active learning scheme can double the rate at which the performance of the model on a test data set improves with additional data compared to choosing the next sample at random. This type of uncertainty quantification and active learning has the potential to open up new areas of materials science, where data are scarce and expensive to obtain, to the transformative power of graph neural networks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。