arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.05313cs.LGcs.SI
收藏

基于强化学习和图神经网络的图动力学控制

Controlling Graph Dynamics with Reinforcement Learning and Graph Neural Networks

NVIDIA Research(英伟达研究院)

Eli A. Meirom, Haggai Maron, Shie Mannor, Gal Chechik

摘要:

我们考虑的问题,控制一个部分观察到的动态过程的图上的有限数量的干预。在安排病毒测试以遏制流行病;有针对性的营销以推广产品;手动检查帖子以检测社交网络上传播的假新闻等情况下,这个问题自然会出现。我们制定这个设置作为一个时序图过程中的顺序决策问题。针对时间图上的指数状态空间、组合动作空间和部分可观测性,设计了一种新的控制方案。我们成功地将我们的方法应用于两个流行的问题,属于我们的框架:优先考虑哪些节点应该进行测试,以遏制流行病的传播,和图上的影响力最大化。

英文摘要:

We consider the problem of controlling a partially-observed dynamic process on a graph by a limited number of interventions. This problem naturally arises in contexts such as scheduling virus tests to curb an epidemic; targeted marketing in order to promote a product; and manually inspecting posts to detect fake news spreading on social networks. We formulate this setup as a sequential decision problem over a temporal graph process. In face of an exponential state space, combinatorial action space and partial observability, we design a novel tractable scheme to control dynamical processes on temporal graphs. We successfully apply our approach to two popular problems that fall into our framework: prioritizing which nodes should be tested in order to curb the spread of an epidemic, and influence maximization on a graph.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑