Ensemble Neural Networks for Remaining Useful Life (RUL) Prediction
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
A core part of maintenance planning is a monitoring system that provides a good prognosis on health and degradation, often expressed as remaining useful life (RUL). Most of the current data-driven approaches for RUL prediction focus on single-point prediction. These point prediction approaches do not include the probabilistic nature of the failure. The few
probabilistic approaches to date either include the aleatoric uncertainty (which originates from the system), or the epistemic uncertainty (which originates from the model param-
eters), or both simultaneously as a total uncertainty. Here, we propose ensemble neural networks for probabilistic RUL predictions which considers both uncertainties and decouples these two uncertainties. These decoupled uncertainties are vital in knowing and interpreting the confidence of the predictions. This method is tested on NASA’s turbofan jet engine CMAPSS data-set. Our results show how these uncertainties can be modeled and how to disentangle the contribution of aleatoric and epistemic uncertainty. Additionally, our approach is evaluated on different metrics and compared against the current state-of-the-art methods.
##plugins.themes.bootstrap3.article.details##
Uncertainty modeling, Probabilistic model, LSTM, Neural network, Ensemble networks
Hullermeier, E., & Waegeman, W. (2021). Aleatoric and ¨ epistemic uncertainty in machine learning: An introduction to concepts and methods. Machine Learning, 110, 457–506.
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2017). Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in neural information processing systems, 30.
Lei, Y., Li, N., Gontarz, S., Lin, J., Radkowski, S., & Dybala, J. (2016). A model-based method for remaining useful life prediction of machinery. IEEE Transactions on reliability, 65(3), 1314–1326.
Liao, Y., Zhang, L., & Liu, C. (2018). Uncertainty prediction of remaining useful life using long short-term memory network based on bootstrap method. In 2018 ieee international conference on prognostics and health management (icphm) (pp. 1–8).
Liu, C., Zhang, L., Liao, Y., Wu, C., & Peng, G. (2019). Multiple sensors based prognostics with prediction interval optimization via echo state gaussian process. IEEE Access, 7, 112397–112409.
Malinin, A., Mlodozeniec, B., & Gales, M. (2019). Ensemble distribution distillation. arXiv preprint arXiv:1905.00076.
Mitici, M., de Pater, I., Barros, A., & Zeng, Z. (2023). Dynamic predictive maintenance for multiple components using data-driven probabilistic rul prognostics: The case of turbofan engines. Reliability Engineering & System Safety, 234, 109199.
Muneer, A., Taib, S. M., Naseer, S., Ali, R. F., & Aziz, I. A. (2021). Data-driven deep learning-based attention mechanism for remaining useful life prediction: Case study application to turbofan engine analysis. Electronics, 10(20), 2453.
Narendhar Gugulothu, V. T., Malhotra, P., Vig, L., Agarwal, P., & Shroff, G. (2018). Predicting remaining useful life using time series embeddings based on recurrent neural networks. International Journal of Prognostics and Health Management, 9.
Nemani, V. P., Lu, H., Thelen, A., Hu, C., & Zimmerman, A. T. (2022). Ensembles of probabilistic lstm predictors and correctors for bearing prognostics using industrial standards. Neurocomputing, 491, 575–596.
Nguyen, K. T., Medjaher, K., & Gogu, C. (2022). Probabilistic deep learning methodology for uncertainty quantification of remaining useful lifetime of multi-component systems. Reliability Engineering & System Safety, 222, 108383.
Ramasso, E. (2014). Investigating computational geometry for failure prognostics in presence of imprecise health indicator: Results and comparisons on c-mapss datasets. In Phm society european conference (Vol. 2).
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008). Damage propagation modeling for aircraft engine runto-failure simulation. In 2008 international conference on prognostics and health management (pp. 1–9).
Tan, M., & Le, Q. (2021). Efficientnetv2: Smaller models and faster training. In International conference on machine learning (pp. 10096–10106).
Xiang, S., Qin, Y., Luo, J., Pu, H., & Tang, B. (2021). Multicellular lstm-based deep learning model for aeroengine remaining useful life prediction. Reliability Engineering & System Safety, 216, 107927.
Xu, H., Fard, N., & Fang, Y. (2020). Time series chain graph for modeling reliability covariates in degradation process. Reliability Engineering & System Safety, 204, 107207.
Yu, W., Kim, I. Y., & Mechefske, C. (2019a). Remaining useful life estimation using a bidirectional recurrent neural network based autoencoder scheme. Mechanical Systems and Signal Processing, 129, 764–780.
Yu, W., Kim, I. Y., & Mechefske, C. (2019b). Remaining useful life estimation using a bidirectional recurrent neural network based autoencoder scheme. Mechanical Systems and Signal Processing, 129, 764–780.
Zhang, C., Lim, P., Qin, A. K., & Tan, K. C. (2016). Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics. IEEE transactions on neural networks and learning systems, 28(10), 2306–2318.
Zhang, X., Xiao, P., Yang, Y., Cheng, Y., Chen, B., Gao, D., . . . Huang, Z. (2019). Remaining useful life estimation using cnn-xgb with extended time window. IEEE Access, 7, 154386–154397.
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., . . . others (2023). A survey of large language models. arXiv preprint arXiv:2303.18223.
Zheng, S., Ristovski, K., Farahat, A., & Gupta, C. (2017). Long short-term memory network for remaining useful life estimation. In 2017 ieee international conference on prog
This work is licensed under a Creative Commons Attribution 3.0 Unported License.