基于鲁棒条件扩散模型的结构监测数据概率质量评估
Probabilistic data quality assessment for structural monitoring data via outlier-resistant conditional diffusion model
AI总结:
本文提出基于预测偏差的结构监测数据质量评估方法,利用单变量隐式自回归模型实现异常检测与数据清洗,通过条件嵌入模块、四分位数归一化和Huber损失提升鲁棒性,实验表明该方法在数据质量评估中优于其他基线方法。
摘要:
数据质量评估是确保后续结构健康监测(SHM)任务可靠性的关键步骤。本文提出一种基于预测偏差的SHM数据质量评估方法,利用单变量隐式自回归模型实现异常诊断和数据清洗。所提出的条件扩散模型(CDM)在标准扩散模型基础上,加入条件嵌入模块以融入时间上下文,四分位数归一化以缓解分布偏斜,并采用Huber损失以增强对异常值的鲁棒性。在该单变量隐式自回归框架中,每个数据点被分配一个异常概率,量化其
英文摘要:
Data quality assessment is an essential step that ensures the reliability of the subsequent structural health monitoring (SHM) tasks. This study proposes a prediction deviation-based SHM data quality assessment method using a univariate implicit auto-regressive model, enabling outlier diagnosis and data cleaning. The proposed conditional diffusion model (CDM) augments the standard diffusion model with a conditional embedding module to incorporate temporal context, quartile normalization to mitigate distribution skew, and a Huber loss to enhance robustness against outliers. Within this univariate implicit autoregressive framework, each data point is assigned an outlier probability, quantifying its degree of "outlier-ness", and a global quality evaluation score is computed to characterize the overall dataset quality. Extensive case studies utilizing operational data from real-world structures demonstrate that the proposed framework significantly improves the accuracy of data quality assessment, outperforming other strong baselines representative of clustering, isolation-based, and deep reconstruction methods. The effectiveness and robustness of the proposed framework are further demonstrated by the findings of ablation experiments and hyperparameter analysis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。