云服务事件的神经网络知识提取
Neural Knowledge Extraction From Cloud Service Incidents
摘要:
在过去的十年中,两个范式转变重塑了软件行业-从盒装产品到服务的转变以及云计算的广泛采用。这对软件开发生存周期和DevOps流程产生了巨大的影响。特别是,事件管理已成为开发和运营大规模服务的关键。创建事件是为了确保及时沟通服务问题及其解决方案。以前的事件管理工作主要集中在事件分类和重复数据消除方面的挑战。在这项工作中,我们解决的基本问题,从服务事件的结构化知识提取。我们已经建立了SoftNER,这是一个从服务事件中进行无监督知识提取的框架。我们框架的知识提取问题作为一个命名实体识别任务,提取事实信息。SoftNER利用键、值对和表等结构模式来引导训练数据。此外,我们建立了一个新的基于多任务学习的BiLSTM-CRF模型,它不仅利用语义上下文,而且还利用命名实体提取的数据类型。我们已经在主要的云服务提供商Microsoft部署了SoftNER,并在超过2个月的云事件中对其进行了评估。我们表明,基于无监督机器学习的方法具有0.96的高精度。我们基于多任务学习的深度学习模型也优于最先进的NER模型。最后,使用SoftNER提取的知识,我们能够为重要的下游任务(如事件分类)构建更准确的模型。
英文摘要:
In the last decade, two paradigm shifts have reshaped the software industry - the move from boxed products to services and the widespread adoption of cloud computing. This has had a huge impact on the software development life cycle and the DevOps processes. Particularly, incident management has become critical for developing and operating large-scale services. Incidents are created to ensure timely communication of service issues and, also, their resolution. Prior work on incident management has been heavily focused on the challenges with incident triaging and de-duplication. In this work, we address the fundamental problem of structured knowledge extraction from service incidents. We have built SoftNER, a framework for unsupervised knowledge extraction from service incidents. We frame the knowledge extraction problem as a Named-entity Recognition task for extracting factual information. SoftNER leverages structural patterns like key,value pairs and tables for bootstrapping the training data. Further, we build a novel multi-task learning based BiLSTM-CRF model which leverages not just the semantic context but also the data-types for named-entity extraction. We have deployed SoftNER at Microsoft, a major cloud service provider and have evaluated it on more than 2 months of cloud incidents. We show that the unsupervised machine learning based approach has a high precision of 0.96. Our multi-task learning based deep learning model also outperforms the state of the art NER models. Lastly, using the knowledge extracted by SoftNER we are able to build significantly more accurate models for important downstream tasks like incident triaging.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。