arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.06323cs.AIcs.HCcs.LG
收藏

无问题调查:一种强化学习方法

Surveys without Questions: A Reinforcement Learning Approach

Adobe Research(奥多比研究院);Google AI(谷歌人工智能);Adobe(奥多比)

Atanu R Sinha, Deepali Jain, Nikhil Sheoran, Sopan Khosla, Reshmi Sasidharan

摘要:

“旧世界”的工具,调查,仍然是一个工具的选择,为公司获得满意度和经验,客户实现,同时与公司在线互动的评级。虽然调查的途径已经从电子邮件和链接发展到浏览时的弹出窗口,但缺陷仍然存在。这些问题包括:依赖极少数受访者的评级来推断所有客户的在线互动;由于评级是一次性快照,无法捕捉客户随时间的互动;以及无法将客户的评级与特定互动联系起来,因为提供的评级与所有互动有关。为了克服这些缺陷,我们提取代理评级的点击流数据,通常收集每个客户的在线互动,通过开发一种基于强化学习(RL)的方法。我们引入了一种新的方法来解释由RL的价值函数生成的值,作为代理评级。我们的方法不需要任何调查数据进行训练。然而,根据实际调查数据的验证,代理评级产生了合理的表现结果。此外,我们提供了一种新的方式来借鉴的见解,从值的价值函数,它允许关联特定的相互作用,他们的代理评级。我们引入了两个新的指标来表示评级-一个是客户级别,另一个是客户之间点击行为的聚合级别。两者都是围绕所有成对的、连续的行动的比例来定义的,这些行动显示代理评级的增加。这种直观的客户级别指标可以衡量评级随时间的变化,并且比调查中的客户评级更能预测购买情况。聚合级指标允许精确定位有助于或损害体验的操作。总而言之,代理评级从点击流中计算,对于每个动作,对于每个客户,对于每个会话,可以提供可解释的和更有见地的替代调查。

英文摘要:

The 'old world' instrument, survey, remains a tool of choice for firms to obtain ratings of satisfaction and experience that customers realize while interacting online with firms. While avenues for survey have evolved from emails and links to pop-ups while browsing, the deficiencies persist. These include - reliance on ratings of very few respondents to infer about all customers' online interactions; failing to capture a customer's interactions over time since the rating is a one-time snapshot; and inability to tie back customers' ratings to specific interactions because ratings provided relate to all interactions. To overcome these deficiencies we extract proxy ratings from clickstream data, typically collected for every customer's online interactions, by developing an approach based on Reinforcement Learning (RL). We introduce a new way to interpret values generated by the value function of RL, as proxy ratings. Our approach does not need any survey data for training. Yet, on validation against actual survey data, proxy ratings yield reasonable performance results. Additionally, we offer a new way to draw insights from values of the value function, which allow associating specific interactions to their proxy ratings. We introduce two new metrics to represent ratings - one, customer-level and the other, aggregate-level for click actions across customers. Both are defined around proportion of all pairwise, successive actions that show increase in proxy ratings. This intuitive customer-level metric enables gauging the dynamics of ratings over time and is a better predictor of purchase than customer ratings from survey. The aggregate-level metric allows pinpointing actions that help or hurt experience. In sum, proxy ratings computed unobtrusively from clickstream, for every action, for each customer, and for every session can offer interpretable and more insightful alternative to surveys.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑