基于图神经网络的量子化学预测模型的极大加速
Extreme Acceleration of Graph Neural Network-based Prediction Models for Quantum Chemistry
摘要:
分子性质计算是化学物理的基础。用于计算分子性质的高保真\textit{ab initio}建模技术可能过于昂贵,并激励开发更有效地进行相同预测的机器学习模型。在大型分子数据库上训练图神经网络引入了独特的计算挑战,例如需要处理数百万个具有可变大小的小图,并支持与在大型图(例如社交网络)上学习不同的通信模式。本文展示了一种新的硬件-软件协同设计方法,以扩大训练的图神经网络的分子性质预测。我们引入了一种算法来合并成固定大小的包的分子图的批次,以消除冗余的计算和内存与替代填充技术,并通过最小化通信提高吞吐量。我们通过在Graphcore智能处理单元(IPU)上实现一个成熟的分子性质预测模型来证明我们的协同设计方法的有效性。我们评估了多个分子图数据库的训练性能,这些数据库具有不同程度的图计数,大小和稀疏性。我们证明,这种协同设计方法可以将这种分子性质预测模型的训练时间从几天减少到不到两个小时,为人工智能驱动的科学发现开辟了新的可能性。
英文摘要:
Molecular property calculations are the bedrock of chemical physics. High-fidelity \textit{ab initio} modeling techniques for computing the molecular properties can be prohibitively expensive, and motivate the development of machine-learning models that make the same predictions more efficiently. Training graph neural networks over large molecular databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. This paper demonstrates a novel hardware-software co-design approach to scale up the training of graph neural networks for molecular property prediction. We introduce an algorithm to coalesce the batches of molecular graphs into fixed size packs to eliminate redundant computation and memory associated with alternative padding techniques and improve throughput via minimizing communication. We demonstrate the effectiveness of our co-design approach by providing an implementation of a well-established molecular property prediction model on the Graphcore Intelligence Processing Units (IPU). We evaluate the training performance on multiple molecular graph databases with varying degrees of graph counts, sizes and sparsity. We demonstrate that such a co-design approach can reduce the training time of such molecular property prediction models from days to less than two hours, opening new possibilities for AI-driven scientific discovery.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。