arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.05911cs.LGcond-mat.dis-nnphysics.chem-phphysics.comp-ph
收藏

终身机器学习势

Lifelong Machine Learning Potentials

ETH Zürich(苏黎世联邦理工学院)

Marco Eckhoff, Markus Reiher

AI总结:

本研究提出元素包容原子中心对称函数和终身机器学习势,利用不确定性量化与持续学习策略实现深度神经网络在新数据流上的自主即时训练,解决了传统MLPs需从头训练及难以表示多化学元素的问题。

摘要:

基于精确量子化学数据训练的机器学习势(MLPs)能够保持高精度,同时计算需求很低。其缺点在于需要为每个特定系统单独训练。近年来,大量MLPs需要从头开始训练,因为学习新数据通常需要在所有数据上重新训练,以避免遗忘先前获取的知识。此外,MLPs最常用的结构描述符无法高效表示大量不同的化学元素。在本研究中,我们通过引入元素包容原子中心对称函数来解决这些问题,该函数将结构性质与元素周期表中的元素信息相结合。这些eeACSFs是我们开发终身机器学习势的关键。不确定性量化可用于突破固定的预训练MLP,从而得到持续适应的lMLP,因为这能确保预定的精度水平。为了将lMLP的适用性扩展到新系统,我们应用了持续学习策略,以实现在连续新数据流上的自主和即时训练。对于深度神经网络的训练,我们提出了持续弹性优化器以及依赖于数据排练、参数正则化和模型架构的增量学习策略。

英文摘要:

Machine learning potentials (MLPs) trained on accurate quantum chemical data can retain the high accuracy, while inflicting little computational demands. On the downside, they need to be trained for each individual system. In recent years, a vast number of MLPs has been trained from scratch because learning additional data typically requires to train again on all data to not forget previously acquired knowledge. Additionally, most common structural descriptors of MLPs cannot represent efficiently a large number of different chemical elements. In this work, we tackle these problems by introducing element-embracing atom-centered symmetry functions (eeACSFs) which combine structural properties and element information from the periodic table. These eeACSFs are a key for our development of a lifelong machine learning potential (lMLP). Uncertainty quantification can be exploited to transgress a fixed, pre-trained MLP to arrive at a continuously adapting lMLP, because a predefined level of accuracy can be ensured. To extend the applicability of an lMLP to new systems, we apply continual learning strategies to enable autonomous and on-the-fly training on a continuous stream of new data. For the training of deep neural networks, we propose the continual resilient (CoRe) optimizer and incremental learning strategies relying on rehearsal of data, regularization of parameters, and the architecture of the model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑