arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.01337cs.LGcs.CLstat.ML
收藏

COTA:通过排名和深度网络提高客户支持的速度和准确性

COTA: Improving the Speed and Accuracy of Customer Support through Ranking and Deep Networks

Uber AI Labs(优步人工智能实验室);Uber Technologies(优步科技)

Piero Molino, Huaixiu Zheng, Yi-Chia Wang

摘要:

对于一家希望提供愉快的用户体验的公司来说,解决任何客户问题都是至关重要的。本文提出了COTA,一个系统,以提高速度和可靠性的客户支持的最终用户,通过自动票分类和答案选择支持代表。展示了两种机器学习和自然语言处理技术:一种依赖于特征工程(COTA v1),另一种通过深度学习架构(COTA v2)利用原始信号。COTA v1采用了一种新的方法,将多分类任务转换为排名问题,在数千个类的情况下表现出显着更好的性能。对于COTA v2,我们提出了一种编码器-组合器-解码器,这是一种新型的深度学习架构,允许异构输入和输出特征类型,并通过网络架构选择注入先验知识。本文比较了这些模型及其变体在门票分类和答案选择任务上的表现,显示模型COTA v2优于COTA v1,并分析了它们的内部工作原理和缺点。最后,在生产环境中进行A/B测试,验证COTA在减少10%的问题解决时间而不降低客户满意度方面的实际影响。

英文摘要:

For a company looking to provide delightful user experiences, it is of paramount importance to take care of any customer issues. This paper proposes COTA, a system to improve speed and reliability of customer support for end users through automated ticket classification and answers selection for support representatives. Two machine learning and natural language processing techniques are demonstrated: one relying on feature engineering (COTA v1) and the other exploiting raw signals through deep learning architectures (COTA v2). COTA v1 employs a new approach that converts the multi-classification task into a ranking problem, demonstrating significantly better performance in the case of thousands of classes. For COTA v2, we propose an Encoder-Combiner-Decoder, a novel deep learning architecture that allows for heterogeneous input and output feature types and injection of prior knowledge through network architecture choices. This paper compares these models and their variants on the task of ticket classification and answer selection, showing model COTA v2 outperforms COTA v1, and analyzes their inner workings and shortcomings. Finally, an A/B test is conducted in a production setting validating the real-world impact of COTA in reducing issue resolution time by 10 percent without reducing customer satisfaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑