研究用于反应坐标的深度神经网络模型的超参数空间
Investigating the hyperparameter space of deep neural network models for reaction coordinates
AI总结:
本文提出基于贝叶斯优化的DNN超参数自动调优方法,用于从集体变量学习反应坐标,并结合XAI分析丙氨酸二肽异构化,发现多模态超参数空间下优化模型仍提取一致机制。
摘要:
识别反应坐标(RCs)是理解复杂系统中反应机制的关键。深度神经网络(DNN)和机器学习方法已成为寻找RC的强大工具。另一方面,决定DNN模型结构的超参数可能具有高度灵活性,并且通常以直觉方式选择,过程既非平凡又繁琐。此外,超参数选择如何影响RC质量仍不清楚。在这里,我们通过开发用于RC的DNN模型的超参数调优方法来探索超参数空间,并研究参数集如何影响RC质量。构建DNN模型以通过最小化交叉熵函数,从各种集体变量预测沿RC的committor;超参数使用贝叶斯优化方法自动确定。该方法被应用于研究丙氨酸二肽在真空和水中的异构化,并使用可解释人工智能(XAI)工具提取表征RC的特征。结果表明,具有不同结构的DNN模型能够以相似的精度描述RC,而且,由XAI分析的特征高度相似。这表明超参数空间是多模态的。从溶剂到氢H18的静电势在水中的RC中起重要作用。当前研究表明,DNN模型的结构可以相当灵活,而适当优化的模型共享相同的特征;因此,可以从RC中提取共同的机制。
英文摘要:
Identifying reaction coordinates (RCs) is a key to understanding the mechanism of reactions in complex systems. Deep neural network (DNN) and machine learning approaches have become a powerful tool to find the RC. On the other hand, the hyperparameters that determine the DNN model structure can be highly flexible and are often selected intuitively and in a non-trivial and tedious manner. Furthermore, how the hyperparameter choice affects the RC quality remains obscure. Here, we explore the hyperparameter space by developing the hyperparameter tuning approach for the DNN model for RC and investigate how the parameter set affects the RC quality. The DNN model is built to predict the committor along the RC from various collective variables by minimizing the cross-entropy function; the hyperparameters are automatically determined using the Bayesian optimization method. The approach is applied to study the isomerization of alanine dipeptide in vacuum and in water, and the features that characterize the RC are extracted using the explainable AI (XAI) tools. The results show that the DNN models with diverse structures can describe the RC with similar accuracy, and furthermore, the features analyzed by XAI are highly similar. This indicates that the hyperparameter space is multimodal. The electrostatic potential from the solvent to the hydrogen H18 plays an important role in the RC in water. The current study shows that the structure of the DNN models can be rather flexible, while the suitably optimized models share the same features; therefore, a common mechanism from the RC can be extracted.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。