本技术说明描述了Graphormer的最新更新,包括架构设计修改以及对3D分子动力学模拟的适应。通过这些简单的修改,Graphormer可以在大规模分子建模数据集上获得比vanilla更好的结果,并且可以在2D和3D分子图建模任务上一致地获得性能增益。此外,我们还表明,通过全局感受野和自适应聚合策略,Graphormer比经典的基于消息传递的GNN更强大。根据经验,Graphormer可以实现比KDD Cup 2021中使用的PCQM 4 M量子化学数据集上最初报告的结果少得多的MAE。与此同时,它在最近的开放式催化剂挑战赛中大大超过了竞争对手,这是NeurIPS 2021研讨会上的竞赛赛道,旨在用先进的人工智能模型对催化剂-吸附物反应系统进行建模。所有代码都可以在https://github.com/Microsoft/Graphormer上找到。
英文摘要:
This technical note describes the recent updates of Graphormer, including architecture design modifications, and the adaption to 3D molecular dynamics simulation. With these simple modifications, Graphormer could attain better results on large-scale molecular modeling datasets than the vanilla one, and the performance gain could be consistently obtained on 2D and 3D molecular graph modeling tasks. In addition, we show that with a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs. Empirically, Graphormer could achieve much less MAE than the originally reported results on the PCQM4M quantum chemistry dataset used in KDD Cup 2021. In the meanwhile, it greatly outperforms the competitors in the recent Open Catalyst Challenge, which is a competition track on NeurIPS 2021 workshop, and aims to model the catalyst-adsorbate reaction system with advanced AI models. All codes could be found at https://github.com/Microsoft/Graphormer.
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Insilico Medicine Hong Kong Ltd;Chemistry and Chemical Biology Department, Harvard University(哈佛大学化学与化学生物学系);Neuromation OU;Hit discovery, Discovery Sciences, Biopharmaceutics R&D, AstraZeneca Gothenburg(阿斯利康哥德堡公司发现科学部药物研发中心);National Research University Higher School of Economics(俄罗斯国家研究型高等经济大学);Department of Chemistry and Department of Computer Science, University of Toronto(多伦多大学化学系与计算机科学系);National Research University Higher School of Economics, St. Petersburg(俄罗斯国家研究型高等经济大学圣彼得堡分校)
CovDocker: Benchmarking Covalent Drug Design with Tasks, Datasets, and Solutions
Huazhong University of Science and Technology(华中科技大学);Microsoft Research AI for Science(微软研究院人工智能科学部);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
A Machine Learning Benchmarking Framework for Lipid Nanoparticle Transfection Efficiency Prediction
Department of Electrical and Computer Engineering, University of Southern California(电气与计算机工程系,南加州大学);University of Cambridge(剑桥大学);School of Pharmacy, University of Wisconsin-Madison(威斯康星大学麦迪逊分校药学院);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);East Tennessee State University(东田纳西州立大学)
RWTH Aachen University(亚琛RWTH大学);University of Oxford(牛津大学);Mila – Quebec AI Institute(魁北克AI研究所);Technion - Israel Institute of Technology(技术学院-以色列理工学院);ETAS Research University of Stuttgart(斯图加特大学ETAS研究所);Google Research(谷歌研究);Microsoft Research(微软研究院)
Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks
Tel-Aviv University(特拉维夫大学);Meta;Technion - Israel Institute of Technology(以色列理工学院);University of Oxford(牛津大学);RWTH Aachen University(亚琛工业大学);NEC Laboratories Europe(欧洲NEC实验室);University of Stuttgart(斯图加特大学);Google Research(谷歌研究院)
Does AI for science need another ImageNet Or totally different benchmarks? A case study of machine learning force fields
Institute of Computing Technology Chinese Academy of Science(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Microsoft Research(微软研究院)
本文以机器学习力场为案例,指出传统 AI 基准测试无法应对 AI4S 的分布外挑战,并提出涵盖样本效率、时域敏感性和跨数据集泛化的新基准方法,作为 SAIBench 项目的一部分。
Deep Learning and Knowledge-Based Methods for Computer Aided Molecular Design -- Toward a Unified Approach: State-of-the-Art and Future Directions
Robert Frederick Smith School of Chemical and Biomolecular Engineering, Cornell University(康奈尔大学罗伯特·弗雷德里克·史密斯化学与生物分子工程学院);College of Engineering, King Saud University(沙特国王大学工程学院);PSE for SPEED Company(PSE for SPEED公司)
Time to Embrace Natural Language Processing (NLP)-based Digital Pathology: Benchmarking NLP- and Convolutional Neural Network-based Deep Learning Pipelines
University of Science and Technology of China(中国科学技术大学);UNSW Sydney(新南威尔士大学);Genmab Inc.(Genmab公司)
A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization
State Key Laboratory of Novel Software Technology, Nanjing University(南京大学现代软件工程国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院)
FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learning
University of Southern California(南加利福尼亚大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);Westlake University(西湖大学);Hunan University(湖南大学)
B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data
University of Edinburgh(爱丁堡大学);Jagiellonian University(雅盖隆大学);Jagiellonian University, Faculty of Mathematics and Computer Science(雅盖隆大学数学与计算机科学学院);Jagiellonian University, Faculty of Chemistry(雅盖隆大学化学学院);Ardigen SA(Ardigen公司)