arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.15071physics.chem-phcond-mat.mtrl-sci
收藏

密度泛函设计中密度尺度约束的对比表征学习

Incorporation of density scaling constraint in density functional design via contrastive representation learning

Weiyi Gong, Tao Sun, Hexin Bai, Shah Tanvir ur Rahman Chowdhury, Peng Chu, Anoj Aryal, Jie Yu, Haibin Ling, John P. Perdew, Qimin Yan

摘要:

在数据驱动的范例中,机器学习(ML)是在密度泛函理论(DFT)中开发准确和通用交换相关(XC)泛函的核心组件。众所周知,XC泛函必须满足几个严格的条件和物理约束,如密度标度,自旋标度和导数不连续性。在这项工作中,我们证明了对比学习是一种计算效率高,灵活的方法,将基于ML的密度泛函设计的物理约束。我们提出了一种示意性的方法,通过在预训练任务中采用对比表示学习,将电子密度的均匀密度标度特性用于交换能。预训练的隐藏表示被转移到下游任务,以预测DFT计算的交换能。从基于对比学习的预训练任务转移的电子密度编码器预测满足标度性质的交换能量,而不使用对比学习训练的模型对标度变换的电子密度系统的预测较差。此外,具有预训练编码器的模型提供了令人满意的性能,仅标记了整个增强数据集的一小部分,与使用整个数据集从头开始训练的模型相当。结果表明,通过对比学习结合精确的约束,可以提高密度-能量映射的理解,使用神经网络(NN)模型与更少的数据标记,这将有利于推广应用的基于NN的XC泛函在广泛的场景,并不总是可用的实验,但理论上是合理的。这项工作代表了一个可行的途径,通过表示学习的机器学习设计的通用密度泛函。

英文摘要:

In a data-driven paradigm, machine learning (ML) is the central component for developing accurate and universal exchange-correlation (XC) functionals in density functional theory (DFT). It is well known that XC functionals must satisfy several exact conditions and physical constraints, such as density scaling, spin scaling, and derivative discontinuity. In this work, we demonstrate that contrastive learning is a computationally efficient and flexible method to incorporate a physical constraint in ML-based density functional design. We propose a schematic approach to incorporate the uniform density scaling property of electron density for exchange energies by adopting contrastive representation learning during the pretraining task. The pretrained hidden representation is transferred to the downstream task to predict the exchange energies calculated by DFT. The electron density encoder transferred from the pretraining task based on contrastive learning predicts exchange energies that satisfy the scaling property, while the model trained without using contrastive learning gives poor predictions for the scaling-transformed electron density systems. Furthermore, the model with pretrained encoder gives a satisfactory performance with only small fractions of the whole augmented dataset labeled, comparable to the model trained from scratch using the whole dataset. The results demonstrate that incorporating exact constraints through contrastive learning can enhance the understanding of density-energy mapping using neural network (NN) models with less data labeling, which will be beneficial to generalizing the application of NN-based XC functionals in a wide range of scenarios that are not always available experimentally but theoretically justified. This work represents a viable pathway toward the machine learning design of a universal density functional via representation learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑