Network maintenance planning via multi-agent reinforcement learning

Thomas, Jonathan; P�rez Hern�ndez, Marco; Parlikad, Ajith Kumar; Piechocki, Robert

Abstract

Within this work, the challenge of developing maintenance planning solutions for networked assets is considered. This is challenging due to the very nature of these systems which are often heterogeneous, distributed and have complex co-dependencies between the constituent components for effective operation. We develop a Multi-Agent Reinforcement Learning (MARL) solution for this domain and apply it to a simulated Radio Access Network (RAN) comprising of nine Base Stations (BS). Through empirical evaluation we show that our model outperforms fixed corrective and preventive maintenance policies in terms of network availability whilst generally utilizing less than or equal amounts of maintenance resource.

Citation

Thomas, J., Pérez Hernández, M., Parlikad, A. K., & Piechocki, R. (2022). Network maintenance planning via multi-agent reinforcement learning. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (2289-2295). https://doi.org/10.1109/SMC52423.2021.9659150

• Conference Name: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
• Conference Location: Melbourne, Australia
• Start Date: Oct 17, 2021
• End Date: Oct 20, 2021
• Acceptance Date: Jul 24, 2021
• Online Publication Date: Jan 6, 2022
• Publication Date: Jan 6, 2022
• Deposit Date: Jan 31, 2022
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Pages: 2289-2295
• Book Title: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
• ISBN: 9781665442084
• DOI: https://doi.org/10.1109/SMC52423.2021.9659150
• Public URL: https://uwe-repository.worktribe.com/output/8543470
• Publisher URL: https://ieeexplore.ieee.org/document/9659150