AIOps中的DRAM故障预测:经验评估、挑战和机遇
DRAM Failure Prediction in AIOps: Empirical Evaluation, Challenges and Opportunities
摘要:
DRAM故障预测是AIOps中的一项重要任务,对于维护大规模数据中心的可靠性和可持续服务至关重要。然而,有限的工作已经做了DRAM故障预测主要是由于缺乏公共可用的数据集。本文使用阿里云通过PAKDD 2021竞赛提供的大规模多源数据集,包括超过300万条内核、地址和mcelog数据记录,对用于DRAM故障预测的各种机器学习技术进行了全面的实证评估。特别是,我们首先制定了一个多类分类任务的问题,并详尽地评估了七个流行的/国家的最先进的分类在个人和多个数据源。然后,我们制定了一个无监督的异常检测任务的问题,并评估三个国家的最先进的异常检测器。此外,根据经验的结果和我们参加这次比赛的经验,我们讨论了主要的挑战,并提出了未来的研究机会,在这项任务。
英文摘要:
DRAM failure prediction is a vital task in AIOps, which is crucial to maintain the reliability and sustainable service of large-scale data centers. However, limited work has been done on DRAM failure prediction mainly due to the lack of public available datasets. This paper presents a comprehensive empirical evaluation of diverse machine learning techniques for DRAM failure prediction using a large-scale multi-source dataset, including more than three millions of records of kernel, address, and mcelog data, provided by Alibaba Cloud through PAKDD 2021 competition. Particularly, we first formulate the problem as a multi-class classification task and exhaustively evaluate seven popular/state-of-the-art classifiers on both the individual and multiple data sources. We then formulate the problem as an unsupervised anomaly detection task and evaluate three state-of-the-art anomaly detectors. Further, based on the empirical results and our experience of attending this competition, we discuss major challenges and present future research opportunities in this task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。