arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.06123physics.chem-phcs.CEcs.LG
收藏

Graphormer在大规模分子模拟数据集上的实证研究

An Empirical Study of Graphormer on Large-Scale Molecular Modeling Datasets

Yu Shi, Shuxin Zheng, Guolin Ke, Yifei Shen, Jiacheng You, Jiyan He, Shengjie Luo, Chang Liu, Di He, Tie-Yan Liu

摘要:

本技术说明描述了Graphormer的最新更新,包括架构设计修改以及对3D分子动力学模拟的适应。“Graphormer-V2”可以在大规模分子建模数据集上获得比vanilla更好的结果,并且可以在下游任务上一致地获得性能增益。此外,我们还表明,通过全局感受野和自适应聚合策略,Graphormer比经典的基于消息传递的GNN更强大。Graphormer-V2在2021年KDD杯使用的PCQM 4 M量子化学数据集上实现的MAE远低于香草Graphormer,后者在此次比赛中获得第一名。与此同时,Graphormer-V2在最近的开放式催化剂挑战赛中大大优于竞争对手,该挑战赛是NeurIPS 2021研讨会的竞赛赛道,旨在用先进的人工智能模型对催化剂-吸附物反应系统进行建模。所有型号均可在\url{https://github.com/Microsoft/Graphormer}上找到。

英文摘要:

This technical note describes the recent updates of Graphormer, including architecture design modifications, and the adaption to 3D molecular dynamics simulation. The "Graphormer-V2" could attain better results on large-scale molecular modeling datasets than the vanilla one, and the performance gain could be consistently obtained on downstream tasks. In addition, we show that with a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs. Graphormer-V2 achieves much less MAE than the vanilla Graphormer on the PCQM4M quantum chemistry dataset used in KDD Cup 2021, where the latter one won the first place in this competition. In the meanwhile, Graphormer-V2 greatly outperforms the competitors in the recent Open Catalyst Challenge, which is a competition track on NeurIPS 2021 workshop, and aims to model the catalyst-adsorbate reaction system with advanced AI models. All models could be found at \url{https://github.com/Microsoft/Graphormer}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑