arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1805.09360cs.LGcs.SIstat.ML
收藏

标记时间点过程的深度强化学习

Deep Reinforcement Learning of Marked Temporal Point Processes

Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)

Utkarsh Upadhyay, Abir De, Manuel Gomez-Rodriguez

摘要:

在各种各样的应用中,人类通过连续时间中的异步随机离散事件与复杂环境进行交互。我们是否可以设计在线干预措施,帮助人类在这种异步环境中实现某些目标?在本文中,我们解决了上述问题的深度强化学习的标记时间点过程的角度来看,由代理采取的行动和它从环境中收到的反馈是异步的随机离散事件,其特征在于使用标记时间点过程。在这样做时,我们使用相应过程的强度和标记分布来定义代理的策略,然后导出一个灵活的策略梯度方法,该方法使用深度递归神经网络将代理的动作和它收到的反馈嵌入到实值向量中。我们的方法不对反馈的强度和标记分布的函数形式做任何假设,并且它允许任意复杂的奖励函数。我们将我们的方法应用于个性化教学和病毒式营销的两种不同应用,并使用从Duolingo和Twitter收集的数据,我们表明,它可能能够找到干预措施,以帮助学习者和营销人员更有效地实现他们的目标。

英文摘要:

In a wide variety of applications, humans interact with a complex environment by means of asynchronous stochastic discrete events in continuous time. Can we design online interventions that will help humans achieve certain goals in such asynchronous setting? In this paper, we address the above problem from the perspective of deep reinforcement learning of marked temporal point processes, where both the actions taken by an agent and the feedback it receives from the environment are asynchronous stochastic discrete events characterized using marked temporal point processes. In doing so, we define the agent's policy using the intensity and mark distribution of the corresponding process and then derive a flexible policy gradient method, which embeds the agent's actions and the feedback it receives into real-valued vectors using deep recurrent neural networks. Our method does not make any assumptions on the functional form of the intensity and mark distribution of the feedback and it allows for arbitrarily complex reward functions. We apply our methodology to two different applications in personalized teaching and viral marketing and, using data gathered from Duolingo and Twitter, we show that it may be able to find interventions to help learners and marketers achieve their goals more effectively than alternatives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑