Deep reinforcement learning-based preventive maintenance for repairable machines with deterioration in a flow line system
Journal
Annals of Operations Research
ISSN
0254-5330
1572-9338
Date Issued
2024-08-06
Author(s)
DOI
10.1007/s10479-024-06207-x
Abstract
In manufacturing systems, preventive maintenance plays a critical role in maintaining product yield, product quality, and machine reliability. Inappropriate maintenance strategies can lead to low yields, faulty products, machine failures, and disrupted operation of upstream and downstream machines. However, developing maintenance strategies in a stochastic factory environment can be challenging due to factors such as varying levels of deterioration, unpredictable maintenance times, and fluctuating machine workloads. Since previous studies formulated the maintenance decision using a Markov decision process, we propose a deep reinforcement learning method to derive the maintenance policy. We also consider the multi-objective method, hypervolume, to illustrate the trade-off between maintenance cost, production loss, and yield loss. The simulation study shows that our proposed method outperforms age-dependent and run-to-failure strategies in ten different scenarios. In addition to obtaining an optimal approximate policy, visualizing action trajectories provides managerial insights for optimizing and balancing different costs. Moreover, implementing preventive maintenance policies derived from our proposed method can enhance the robustness of supply chain operations. By reducing the risk of unexpected equipment failures, supply chains can achieve higher levels of operational reliability and continuity.
Subjects
Deep reinforcement learning
Machine reliability
Multiobjective reinforcement learning
Preventive maintenance
SDGs
Publisher
Springer Science and Business Media LLC
Type
journal article