Existing predictive maintenance (PdM) methods typically focus solely on whether to replace system components without considering the costs incurred by inspection. However, a well-considered approach should be able to minimize Remaining Useful Life (RUL) at engine replacement while maximizing inspection interval. To achieve this, multi-agent reinforcement learning (MARL) can be introduced. However, due to the sequential and mutually constraining nature of these 2 objectives, conventional MARL is not applicable. Therefore, this paper introduces a novel framework and develops a Sequential Multi-objective Multi-agent Proximal Policy Optimization (SMOMA-PPO) algorithm. Furthermore, to provide comprehensive and effective degradation information to RL agents, we also employed Gated Recurrent Unit, quantile regression, and probability distribution fitting to develop a GRU-based RUL Prediction (GRP) model. Experiments demonstrate that the GRP method significantly improves the accuracy of RUL predictions in the later stages of system operation compared to existing methods. When incorporating its output into SMOMA-PPO, we achieve at least a 15% reduction in average RUL without unscheduled replacements (UR), nearly a 10% increase in inspection interval, and an overall decrease in maintenance costs. Importantly, our approach offers a new perspective for addressing multi-objective maintenance planning with sequential constraints, effectively enhancing system reliability and reducing maintenance expenses.
Auton Lab, Carnegie Mellon University（卡内基梅隆大学 Auton 实验室）
This paper reviews current literature in the field of predictive maintenance from the system point of view. We differentiate the existing capabilities of condition estimation and failure risk forecasting as currently applied to simple components, from the capabilities needed to solve the same tasks for complex assets. System-level analysis faces more complex latent degradation states, it has to comprehensively account for active maintenance programs at each component level and consider coupling between different maintenance actions, while reflecting increased monetary and safety costs for syst…
Predictive maintenance is an effective tool for reducing maintenance costs. Its effectiveness relies heavily on the ability to predict the future state of health of the system, and for this survival models have shown to be very useful. Due to the complex behavior of system degradation, data-driven methods are often preferred, and neural network-based methods have been shown to perform particularly very well. Many neural network-based methods have been proposed and successfully applied to many problems. However, most models rely on assumptions that often are quite restrictive and there is an in…
Recent years have seen an unprecedented growth in the use of sensor data to guide wind farm operations and maintenance. Emerging sensor-driven approaches typically focus on optimal maintenance procedures for single turbine systems, or model multiple turbines in wind farms as single component entities. In reality, turbines are composed of multiple components that dynamically interact throughout their lifetime. These interactions are central for realistic assessment and control of turbine failure risks. In this paper, an integrated framework that combines i) real-time degradation models used for…
This paper highlights the trends in the field of predictive maintenance with the use of machine learning. With the continuous development of the Fourth Industrial Revolution, through IoT, the technologies that use artificial intelligence are evolving. As a result, industries have been using these technologies to optimize their production. Through scientific research conducted for this paper, conclusions were drawn about the trends in Predictive Maintenance applications with the use of machine learning bridging Artificial Intelligence and IoT. These trends are related to the types of industries…
This paper investigates the combination of two model predictive control concepts, sequential model predictive control and long-horizon model predictive control for power electronics. To achieve sequential model predictive control, the optimization problem is split into two subproblems: The first one summarizes all control goals which linearly depend on the system inputs. Sequential model predictive control generally requires to obtain more than one solution for the first subproblem. Due to the mixed-integer nature of finite control set model predictive control power electronics a special spher…
Integrating Prognostics, Maintenance, and Tail Assignment under Remaining Useful Life Uncertainty: A Stochastic Optimisation Approach for Airline Reliability
Delft University of Technology（代尔夫特理工大学）；Zurich University of Applied Sciences（苏黎世应用科学大学）；Swiss International Air Lines Ltd.（瑞士国际航空公司）
该研究针对航空公司运营中 RUL 不确定性下 TA 与 MS 单独优化的问题，提出联合整合 TA、MS 与 PdM 的随机优化框架，经真实数据验证可降低运营风险。
Real-Time Reconfiguration and Connectivity Maintenance for AUVs Network Under External Disturbances using Distributed Nonlinear Model Predictive Control
Within smart manufacturing, data driven techniques are commonly adopted for condition monitoring and fault diagnosis of rotating machinery. Classical approaches use supervised learning where a classifier is trained on labeled data to predict or classify different operational states of the machine. However, in most industrial applications, labeled data is limited in terms of its size and type. Hence, it cannot serve the training purpose. In this paper, this problem is tackled by addressing the classification task as a similarity measure to a reference sample rather than a supervised classificat…
Multilayer GNN for Predictive Maintenance and Clustering in Power Grids
organization= Industrial \& Manufacturing Engineering, North Dakota State University , addressline= NDSU Dept. 2485, PO Box 6050 , city= Fargo , postcode= 58108-6050 , state= ND , country= USA；organization= Department of Engineering Technology \& Construction Management, University of North Carolina at Charlotte , postcode= 28223 , state= NC , country= USA；organization= Department of Industrial \& Systems Engineering, North Carolina Agriculture \& Tech State University , city= Greensboro , postcode= 27411 , state= NC , country= USA；organization= Department of Industrial \& Management Systems Engineering, University of South Florida , addressline= 4202 East Fowler Avenue, ENG 030 , city= Tampa , postcode= 33620 , state= FL , country= USA
