arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.06395cs.CLcs.LG
收藏

人机混合客服系统会话级弱信号会话评价

Turn-level Dialog Evaluation with Dialog-level Weak Signals for Bot-Human Hybrid Customer Service Systems

Ruofeng Wen

摘要:

我们开发了一种机器学习方法,可以在互动过程中的任何时候量化客户服务联系中的成功或价值的多个方面。具体而言,关于跨人类代理、聊天机器人和其他混合对话系统的回合级行为的价值/奖励函数的特征在于基于来自仅用对话级属性/状态中的弱信号训练的多任务神经网络的令牌级预测的语句之间的增量信息和置信度增益。由此产生的模型名为Value Profiler,作为一个面向目标的对话管理器,通过使用其奖励和状态预测来调节自动决策,从而增强对话。它支持对机器人和人工处理的联系人进行实时监控和可扩展的离线客户体验评估。我们展示了它如何在几个应用程序中提高亚马逊客户服务质量。

英文摘要:

We developed a machine learning approach that quantifies multiple aspects of the success or values in Customer Service contacts, at anytime during the interaction. Specifically, the value/reward function regarding to the turn-level behaviors across human agents, chatbots and other hybrid dialog systems is characterized by the incremental information and confidence gain between sentences, based on the token-level predictions from a multi-task neural network trained with only weak signals in dialog-level attributes/states. The resulting model, named Value Profiler, serves as a goal-oriented dialog manager that enhances conversations by regulating automated decisions with its reward and state predictions. It supports both real-time monitoring and scalable offline customer experience evaluation, for both bot- and human-handled contacts. We show how it improves Amazon customer service quality in several applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑