arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.06217cs.CL
收藏

基于外部知识和两阶段Q函数的强化学习预测Reddit热门话题

Reinforcement Learning with External Knowledge and Two-Stage Q-functions for Predicting Popular Reddit Threads

University of Washington(华盛顿大学);Microsoft Research(微软研究院)

Ji He, Mari Ostendorf, Xiaodong He

摘要:

本文解决了使用强化学习预测在线论坛中评论流行度的问题,特别是解决了由自然语言状态和动作空间引起的两个挑战。首先,状态表示,其特征在于在一个特定的点上的讨论中跟踪的评论的历史,被增强,以纳入由外部知识源中可用的世界事件的讨论所表示的全球背景。其次,引入了一个两阶段的Q学习框架,使其可行的搜索组合动作空间,同时也占子动作之间的冗余。我们对五个Reddit社区进行了实验,结果表明这两种方法比以前报告的结果有所改进。

英文摘要:

This paper addresses the problem of predicting popularity of comments in an online discussion forum using reinforcement learning, particularly addressing two challenges that arise from having natural language state and action spaces. First, the state representation, which characterizes the history of comments tracked in a discussion at a particular point, is augmented to incorporate the global context represented by discussions on world events available in an external knowledge source. Second, a two-stage Q-learning framework is introduced, making it feasible to search the combinatorial action space while also accounting for redundancy among sub-actions. We experiment with five Reddit communities, showing that the two methods improve over previous reported results on this task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑