Optimal Inspection and Maintenance Planning for Deteriorating Structural Components through Dynamic Bayesian Networks and Markov Decision Processes
arXiv:2009.04547 · doi:10.1016/j.strusafe.2021.102140
Abstract
Civil and maritime engineering systems, among others, from bridges to offshore platforms and wind turbines, must be efficiently managed as they are exposed to deterioration mechanisms throughout their operational life, such as fatigue or corrosion. Identifying optimal inspection and maintenance policies demands the solution of a complex sequential decision-making problem under uncertainty, with the main objective of efficiently controlling the risk associated with structural failures. Addressing this complexity, risk-based inspection planning methodologies, supported often by dynamic Bayesian networks, evaluate a set of pre-defined heuristic decision rules to reasonably simplify the decision problem. However, the resulting policies may be compromised by the limited space considered in the definition of the decision rules. Avoiding this limitation, Partially Observable Markov Decision Processes (POMDPs) provide a principled mathematical methodology for stochastic optimal control under uncertain action outcomes and observations, in which the optimal actions are prescribed as a function of the entire, dynamically updated, state probability distribution. In this paper, we combine dynamic Bayesian networks with POMDPs in a joint framework for optimal inspection and maintenance planning, and we provide the formulation for developing both infinite and finite horizon POMDPs in a structural reliability context. The proposed methodology is implemented and tested for the case of a structural component subject to fatigue deterioration, demonstrating the capability of state-of-the-art point-based POMDP solvers for solving the underlying planning optimization problem. Within the numerical experiments, POMDP and heuristic-based policies are thoroughly compared, and results showcase that POMDPs achieve substantially lower costs as compared to their counterparts, even for traditional problem settings.
References in corpus (2)
Cited by in corpus (10)
- A framework for quantifying the value of vibration-based structural health monitoring
- Inference and dynamic decision-making for deteriorating systems with probabilistic dependencies through Bayesian networks and deep reinforcement learning
- Farm-wide virtual load monitoring for offshore wind structures via Bayesian neural networks
- Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints
- Knowledge Engineering for Wind Energy
- Monitoring-Supported Value Generation for Managing Structures and Infrastructure Systems
- Welfare Maximization Algorithm for Solving Budget-Constrained Multi-Component POMDPs
- A composition of simplified physics-based model with neural operator for trajectory-level seismic response predictions of structural systems
- Balancing the exploration-exploitation trade-off in active learning for surrogate model-based reliability analysis via multi-objective optimization
- An Information-Theoretic Method for Dynamic System Identification With Output-Only Damping Estimation