PHM-Bench: A Domain-Specific Benchmarking Framework for Systematic Evaluation of Large Models in Prognostics and Health Management
Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新学院);Institute of Reliability Engineering, Beihang University(北京航空航天大学可靠性工程研究所);Science & Technology on Reliability & Environmental Engineering Laboratory(可靠性与环境工程技术重点实验室);School of Reliability and Systems Engineering, Beihang University(北京航空航天大学可靠性与系统工程学院)
Puyu Yang, Laifa Tao, Zijian Huang, Haifei Liu, Wenyan Cao, Hao Ji, Jianan Qiu, Qixuan Huang, Xuanyuan Su, Yuhang Xie, Jun Zhang, Shangyu Li, Chen Lu, Zhixuan Lian
With the rapid advancement of generative artificial intelligence, large language models (LLMs) are increasingly adopted in industrial domains, offering new opportunities for Prognostics and Health Management (PHM). These models help address challenges such as high development costs, long deployment cycles, and limited generalizability. However, despite the growing synergy between PHM and LLMs, existing evaluation methodologies often fall short in structural completeness, dimensional comprehensiveness, and evaluation granularity. This hampers the in-depth integration of LLMs into the PHM domain. To address these limitations, this study proposes PHM-Bench, a novel three-dimensional evaluation framework for PHM-oriented large models. Grounded in the triadic structure of fundamental capability, core task, and entire lifecycle, PHM-Bench is tailored to the unique demands of PHM system engineering. It defines multi-level evaluation metrics spanning knowledge comprehension, algorithmic generation, and task optimization. These metrics align with typical PHM tasks, including condition monitoring, fault diagnosis, RUL prediction, and maintenance decision-making. Utilizing both curated case sets and publicly available industrial datasets, our study enables multi-dimensional evaluation of general-purpose and domain-specific models across diverse PHM tasks. PHM-Bench establishes a methodological foundation for large-scale assessment of LLMs in PHM and offers a critical benchmark to guide the transition from general-purpose to PHM-specialized models.
On the Soundness of XAI in Prognostics and Health Management (PHM)
Departamento de Ciencias de la Computación e Inteligencia Artificial(计算机科学与人工智能系);Datrik Intelligence, S.A.(Datrik智能股份公司);Universidad de Sevilla(塞维利亚大学)
An Outline of Prognostics and Health Management Large Model: Concepts, Paradigms, and Challenges
Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新研究院);Institute of Reliability Engineering, Beihang University(北京航空航天大学可靠性工程研究所);Science & Technology on Reliability & Environmental Engineering Laboratory(可靠性与环境工程技术重点实验室);School of Reliability and Systems Engineering, Beihang University(北京航空航天大学可靠性与系统工程学院)
BACE-RUL: A Bi-directional Adversarial Network with Covariate Encoding for Machine Remaining Useful Life Prediction
School of Software Engineering, Sun Yat-Sen University(中山大学软件学院);School of Computer Science and Technology, China University of Mining and Technology(中国矿业大学计算机科学与技术学院);National University of Singapore(新加坡国立大学)
Maintenance Strategies for Sewer Pipes with Multi-State Degradation and Deep Reinforcement Learning
Ruhr-University Bochum(波鸿鲁尔大学);University of Twente(特温特大学);Eindhoven University of Technology(埃因霍温理工大学);Rolsch Assetmanagement(罗尔施资产管理公司);Radboud University(拉德堡德大学)