arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.11807cs.LG
收藏

用于晶体材料性能预测的周期图Transformers

Periodic Graph Transformers for Crystal Material Property Prediction

Texas A&M University(德克萨斯农工大学);Florida State University(佛罗里达州立大学)

Keqiang Yan, Yi Liu, Yuchao Lin, Shuiwang Ji

摘要:

我们考虑周期图编码晶体材料上的表示学习。与正则图不同的是,周期图是由三维空间中的一个最小单元格在一个正则格上重复自己组成的。如何有效地编码这些周期性结构提出了独特的挑战,不存在于规则图表示学习。除了是E(3)不变的,周期图表示需要是周期不变的。也就是说,学习的表示应该对人为施加的细胞边界的移位保持不变。此外,需要明确地捕获周期性重复图案,因为不同尺寸和取向的晶格可能对应于不同的材料。在这项工作中,我们提出了一个Transformer架构,称为Matformer,用于周期图表示学习。我们的Matformer被设计为不随周期变化,并且可以明确地捕获重复模式。特别是,Matformer通过有效利用相邻单元中相同原子之间的几何距离来编码周期性图案。在多个常见基准数据集上的实验结果表明,我们的Matformer始终优于基线方法。此外,我们的研究结果表明,晶体表示学习的周期不变性和明确的重复模式编码的重要性。

英文摘要:

We consider representation learning on periodic graphs encoding crystal materials. Different from regular graphs, periodic graphs consist of a minimum unit cell repeating itself on a regular lattice in 3D space. How to effectively encode these periodic structures poses unique challenges not present in regular graph representation learning. In addition to being E(3) invariant, periodic graph representations need to be periodic invariant. That is, the learned representations should be invariant to shifts of cell boundaries as they are artificially imposed. Furthermore, the periodic repeating patterns need to be captured explicitly as lattices of different sizes and orientations may correspond to different materials. In this work, we propose a transformer architecture, known as Matformer, for periodic graph representation learning. Our Matformer is designed to be invariant to periodicity and can capture repeating patterns explicitly. In particular, Matformer encodes periodic patterns by efficient use of geometric distances between the same atoms in neighboring cells. Experimental results on multiple common benchmark datasets show that our Matformer outperforms baseline methods consistently. In addition, our results demonstrate the importance of periodic invariance and explicit repeating pattern encoding for crystal representation learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑