软测量Transformer:数百个传感器值得一个字
Soft Sensing Transformer: Hundreds of Sensors are Worth a Single Word
摘要:
近年来,随着人工智能技术的飞速发展,软测量领域出现了许多基于深度学习模型的研究。然而,模型变得更加复杂,但数据集仍然有限:研究人员正在用数百个数据样本拟合数百万个参数模型,这不足以锻炼其模型的有效性,因此在工业应用中实施时往往无法执行。为了解决这个长期存在的问题,我们向公众提供希捷科技的大规模、高维时间序列制造传感器数据。我们展示了在这些数据集上通过软测量Transformer模型对工业大数据建模的挑战和有效性。之所以使用Transformer,是因为它在自然语言处理中的表现优于最先进的技术,并且从那时起,在直接应用于计算机视觉时也表现良好,而不会引入图像特定的感应偏差。我们观察句子结构与传感器读数的相似性,并以与自然语言中的句子相似的方式处理时间序列中的多变量传感器读数。高维时间序列数据被格式化为相同形状的嵌入语句,并输入到Transformer模型中。结果表明,Transformer模型在软测量领域的性能优于基于自编码器和长短期记忆(LSTM)模型的基准模型。据我们所知,我们是学术界或工业界第一个用大规模数值软测量数据对原始Transformer模型性能进行基准测试的团队。
英文摘要:
With the rapid development of AI technology in recent years, there have been many studies with deep learning models in soft sensing area. However, the models have become more complex, yet, the data sets remain limited: researchers are fitting million-parameter models with hundreds of data samples, which is insufficient to exercise the effectiveness of their models and thus often fail to perform when implemented in industrial applications. To solve this long-lasting problem, we are providing large scale, high dimensional time series manufacturing sensor data from Seagate Technology to the public. We demonstrate the challenges and effectiveness of modeling industrial big data by a Soft Sensing Transformer model on these data sets. Transformer is used because, it has outperformed state-of-the-art techniques in Natural Language Processing, and since then has also performed well in the direct application to computer vision without introduction of image-specific inductive biases. We observe the similarity of a sentence structure to the sensor readings and process the multi-variable sensor readings in a time series in a similar manner of sentences in natural language. The high-dimensional time-series data is formatted into the same shape of embedded sentences and fed into the transformer model. The results show that transformer model outperforms the benchmark models in soft sensing field based on auto-encoder and long short-term memory (LSTM) models. To the best of our knowledge, we are the first team in academia or industry to benchmark the performance of original transformer model with large-scale numerical soft sensing data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。