原子神经网络预测的不确定性量化
Uncertainty quantification for predictions of atomistic neural networks
摘要:
定量地探讨了不确定性量化对训练好的神经网络(NN)预测量子化学参比数据的价值。为此,对PhysNet NN的架构进行了适当的修改,并使用不同的指标对所得模型进行了评估,以量化校准、预测质量以及预测误差和预测不确定性是否相关。在QM 9数据库上训练和评估分布内外测试集的数据的结果表明,误差和不确定性不是线性相关的。结果澄清,噪音和冗余复杂的性质预测的分子,即使在这种情况下的变化-例如双键迁移在两个其他相同的分子-是小的。然后将该模型应用于一个真实的互变异构反应数据库。结合其他参数对特征空间中成员间距离的分析表明,训练数据集中的冗余信息会导致大的方差和小的误差,而相似但不特定的信息的存在会返回大的误差但小的方差。这是,例如,观察到含硝基的脂肪链,虽然训练集包含几个硝基与芳香分子结合的例子,但预测是困难的。这强调了训练数据组成的重要性,并提供了对这如何影响ML模型预测能力的化学见解。最后,提出的方法可以用于基于信息的改进化学数据库的目标应用,通过主动学习优化。
英文摘要:
The value of uncertainty quantification on predictions for trained neural networks (NNs) on quantum chemical reference data is quantitatively explored. For this, the architecture of the PhysNet NN was suitably modified and the resulting model was evaluated with different metrics to quantify calibration, quality of predictions, and whether prediction error and the predicted uncertainty can be correlated. The results from training on the QM9 database and evaluating data from the test set within and outside the distribution indicate that error and uncertainty are not linearly related. The results clarify that noise and redundancy complicate property prediction for molecules even in cases for which changes - e.g. double bond migration in two otherwise identical molecules - are small. The model was then applied to a real database of tautomerization reactions. Analysis of the distance between members in feature space combined with other parameters shows that redundant information in the training dataset can lead to large variances and small errors whereas the presence of similar but unspecific information returns large errors but small variances. This was, e.g., observed for nitro-containing aliphatic chains for which predictions were difficult although the training set contained several examples for nitro groups bound to aromatic molecules. This underlines the importance of the composition of the training data and provides chemical insight into how this affects the prediction capabilities of a ML model. Finally, the approach put forward can be used for information-based improvement of chemical databases for target applications through active learning optimization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。