arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.01092cs.SE
收藏

支持分析师对他们的客户了解多少?关于大型软件组织中支持票升级的研究和预测

What do Support Analysts Know about Their Customers? On the Study and Prediction of Support Ticket Escalations in Large Software Organizations

Lloyd Montgomery, Daniela Damian

摘要:

理解并保持客户满意是需求工程的核心原则。收集、分析和协商需求的策略是通过在产品部署后管理客户输入的努力来补充的。对于后者,支持票是允许客户提交问题,错误报告和功能请求的关键。然而,如果对支持问题关注不够,那么将问题上报管理层既耗时又昂贵,特别是对于管理着数百名客户和数千张支持票的大型组织而言。我们的工作为简化支持分析师和管理人员的工作迈出了一步,特别是在预测升级支持票据的风险方面。在我们的大型工业合作伙伴IBM的一项实地研究中,我们使用设计科学方法来描述IBM分析师在管理升级时可用的支持流程和数据。通过设计和评估的迭代循环,我们将对支持分析师的客户专业知识的理解转化为支持票证模型的特征,并将其实施为机器学习模型,以预测支持票证升级。我们在超过250万张支持票和10,000次升级上训练和评估了我们的机器学习模型,为希望识别有升级风险的支持票的支持分析师获得了79.9%的召回率和80.8%的工作量减少。进一步的现场评估,通过我们开发的原型工具,以实现我们的机器学习技术在实践中,显示更有效的每周支持票管理会议。我们在支持票模型中开发的功能旨在为有兴趣实施我们的模型来预测支持票升级的组织提供一个起点,并为未来的研究人员提供进一步的研究。

英文摘要:

Understanding and keeping the customer happy is a central tenet of requirements engineering. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. Whenever insufficient attention is given to support issues, however, their escalation to management is time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. Our work provides a step towards simplifying the job of support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, we used a design science methodology to characterize the support process and data available to IBM analysts in managing escalations. Through iterative cycles of design and evaluation, we translated our understanding of support analysts' expert knowledge of their customers into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. We trained and evaluated our Machine Learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9% and an 80.8% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. Further on-site evaluations, through a prototype tool we developed to implement our Machine Learning techniques in practice, showed more efficient weekly support-ticket-management meetings. The features we developed in the Support Ticket Model are designed to serve as a starting place for organizations interested in implementing our model to predict support ticket escalations, and for future researchers to build on to advance research in ...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑