arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.02641cs.LGcs.AI
收藏

TFBEST:具有可学习位置编码的双方面Transformer用于故障预测

TFBEST: Dual-Aspect Transformer with Learnable Positional Encoding for Failure Prediction

San José State University(圣何塞州立大学)

Rohan Mohapatra, Saptarshi Sengupta

AI总结:

针对数据中心硬盘故障预测,提出TFBEST双方面Transformer架构,利用可学习位置编码和置信边际统计量,在Backblaze十年数据上显著优于现有RUL预测方法。

摘要:

数据中心中硬盘驱动器(HDD)的故障代价高昂——从灾难性的数据丢失到信誉问题,利益相关者都希望尽可能避免这种情况。主动监控HDD故障的一个重要工具是及时估计剩余使用寿命(RUL)。为此,HDD内部采用的自监控、分析和报告技术(S.M.A.R.T.)提供了关键日志,用于长期维护这些基本数据存储设备的安全性和可靠性。过去的数据驱动预测模型大量使用这些S.M.A.R.T.日志以及基于CNN/RNN的架构。然而,它们在提供预测RUL值周围的置信区间以及处理非常长的日志序列方面存在显著不足。此外,其中一些方法(如基于LSTM的方法)本质上训练速度慢,且具有繁琐的特征工程开销。为了克服这些挑战,在这项工作中,我们提出了一种新颖的Transformer架构——时间融合双编码器自注意力Transformer(TFBEST),用于预测硬盘故障。它是一种基于编码器-解码器的深度学习技术,增强了从理解健康统计序列中获得的上下文,并预测磁盘可能发生故障前的剩余天数序列。在本文中,我们还提供了一种新颖的置信边际统计量,可帮助制造商在特定时间范围内更换硬盘。在希捷HDD数据上的实验表明,我们的方法在Backblaze(2013年至今)提供的全面10年数据测试中,显著优于最先进的RUL预测方法。尽管在HDD故障预测上进行了验证,但TFBEST架构也非常适用于其他预测性维护应用,并可能适用于相关的回归问题。

英文摘要:

Hard Disk Drive (HDD) failures in datacenters are costly - from catastrophic data loss to a question of goodwill, stakeholders want to avoid it like the plague. An important tool in proactively monitoring against HDD failure is timely estimation of the Remaining Useful Life (RUL). To this end, the Self-Monitoring, Analysis and Reporting Technology employed within HDDs (S.M.A.R.T.) provide critical logs for long-term maintenance of the security and dependability of these essential data storage devices. Data-driven predictive models in the past have used these S.M.A.R.T. logs and CNN/RNN based architectures heavily. However, they have suffered significantly in providing a confidence interval around the predicted RUL values as well as in processing very long sequences of logs. In addition, some of these approaches, such as those based on LSTMs, are inherently slow to train and have tedious feature engineering overheads. To overcome these challenges, in this work we propose a novel transformer architecture - a Temporal-fusion Bi-encoder Self-attention Transformer (TFBEST) for predicting failures in hard-drives. It is an encoder-decoder based deep learning technique that enhances the context gained from understanding health statistics sequences and predicts a sequence of the number of days remaining before a disk potentially fails. In this paper, we also provide a novel confidence margin statistic that can help manufacturers replace a hard-drive within a time frame. Experiments on Seagate HDD data show that our method significantly outperforms the state-of-the-art RUL prediction methods during testing over the exhaustive 10-year data from Backblaze (2013-present). Although validated on HDD failure prediction, the TFBEST architecture is well-suited for other prognostics applications and may be adapted for allied regression problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑