基于特征工程的客户支持票升级预测
Customer Support Ticket Escalation Prediction using Feature Engineering
摘要:
理解并保持客户满意是需求工程的核心原则。收集、分析和协商需求的策略是通过在产品部署后管理客户输入的努力来补充的。对于后者,支持票是允许客户提交问题,错误报告和功能请求的关键。但是,如果对支持问题关注不够,那么将其上报管理层将变得既耗时又昂贵,特别是对于管理数百名客户和数千张支持票的大型组织而言。我们的工作为简化支持分析师和管理人员的工作迈出了一步,特别是在预测升级支持票据的风险方面。在我们的大型工业合作伙伴IBM的一项实地研究中,我们使用设计科学研究方法论来描述IBM分析师在管理升级时可用的支持流程和数据。然后,我们将这些功能实现到一个机器学习模型中,以预测支持票的升级。我们在超过250万张支持票和10,000次升级上训练和评估了我们的机器学习模型,为希望识别升级风险的支持票的支持分析师获得了87.36%的召回率和88.23%的工作量减少。最后,除了这些研究评估活动,我们比较了我们的支持票模型的性能与没有功能工程开发的模型;支持票模型功能优于非工程模型。在这项研究中创建的工件旨在作为有兴趣预测支持票升级的组织的起点,并为未来的研究人员建立在升级预测的基础上推进研究。
英文摘要:
Understanding and keeping the customer happy is a central tenet of requirements engineering. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. If insufficient attention is given to support issues, however, their escalation to management becomes time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. Our work provides a step towards simplifying the job of support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, we used a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implemented these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. Finally, in addition to these research evaluation activities, we compared the performance of our support ticket model with that of a model developed with no feature engineering; the support ticket model features outperformed the non-engineered model. The artifacts created in this research are designed to serve as a starting place for organizations interested in predicting support ticket escalations, and for future researchers to build on to advance research in escalation prediction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。