Improving Graph Property Prediction with Generalized Readout Functions
Eric Alcaide
备注:
The experiments were not conducted appropiately (not the same protocol as the ones they were compared with). These results shouldn't be compared with the OGB Leaderboard
图属性预测近年来受到越来越多的关注,因为图是最通用的数据结构之一,可包含任意数量的节点及节点间连接,也是网络、分子、知识库等这类数据上分类、回归等诸多不同任务的基础。我们提出了一种新型广义全局池化层,以缓解消息传递神经网络(Message-Passing Neural Networks)在Readout阶段通常出现的信息损失问题。该新型层由两个可选择学习的参数($β$和$p$)参数化,其执行的变换在特定设置下可退化为几种已流行的readout函数(均值、最大值、求和),这些设置可预先指定。为展示该新技术更优的表达能力和性能,我们在一项主流图属性预测任务中对其进行测试,采用当前性能最优的架构,将我们的readout层作为即插即用替换组件,并取得了新的 state of the art 结果。复现实验的代码可通过以下链接获取:https://github.com/EricAlcaide/generalized-readout-phase
英文摘要:
Graph property prediction is drawing increasing attention in the recent years due to the fact that graphs are one of the most general data structures since they can contain an arbitrary number of nodes and connections between them, and it is the backbone for many different tasks like classification and regression on such kind of data (networks, molecules, knowledge bases, ...). We introduce a novel generalized global pooling layer to mitigate the information loss that typically occurs at the Readout phase in Message-Passing Neural Networks. This novel layer is parametrized by two values ($β$ and $p$) which can optionally be learned, and the transformation it performs can revert to several already popular readout functions (mean, max and sum) under certain settings, which can be specified. To showcase the superior expressiveness and performance of this novel technique, we test it in a popular graph property prediction task by taking the current best-performing architecture and using our readout layer as a drop-in replacement and we report new state of the art results. The code to reproduce the experiments can be accessed here: https://github.com/EricAlcaide/generalized-readout-phase
Improving Counterfactual Truthfulness for Molecular Property Prediction through Uncertainty Quantification
Institute of Theoretical Informatics, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院理论信息学研究所);Institute of Nanotechnology, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院纳米技术研究所)
Research on Intellectual Property Resource Profile and Evolution Law
Beijing Key Laboratory of Intelligent Communication Software and Multimedia(智能通信软件与多媒体北京重点实验室);School of Computer, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);Beijing University of Posts and Telecommunications(北京邮电大学)