Data-Driven Prognostics with Multi-Layer Perceptron Particle Filter: a Cross-Industry Exploration
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Sylvain Girard Jean-Marc Bourinet
Abstract
The integration of particle or Kalman filters with machine learning tools like support vector machines, Gaussian processes, or neural networks has seen extensive exploration in the context of prognostic and health management, particularly in model-based applications. This paper focuses on the Multi-Layer Perceptron Particle Filter (MLP-PF), a data-driven approach that harnesses the non-linearity of MLP to describe degradation trajectories without relying on a physical model. The Bayesian nature of the particle filter is utilized to update MLP parameters, providing flexibility to the method and accommodating unexpected changes in the degradation behavior. To showcase the versatility of MLP-PF, this work demonstrates its seamless integration into diverse use cases, such as lithium-ion battery analysis, virtual health monitoring for turbofans, and the assessment of fatigue crack growth. We illustrate how it effortlessly accommodates various contexts through slight parameter modifications. Adjustment includes variation in the number of neurons or layers in the MLP, threshold adjustments, initial training refinements and the adaptation of the process noise. Addressing different degradation processes across these applications, MLP-PF proves its adaptability and utility in various contexts. These findings highlight the method’s versatility in adapting to diverse use cases and its potential as a robust prognostic tool across various industries. MLP-PF offers a practical and efficient means of estimating remaining useful life and predicting degradation in complex systems, with implications for advancing prognostic tools in diverse applications.
How to Cite
##plugins.themes.bootstrap3.article.details##
Particle Filter, Neural Network, Lithium-Ion Batteries, Fatigue Crack Growth, Turbofans SOH
T. (2002). A tutorial on particle filters for online nonlinear/nongaussian bayesian tracking. IEEE Transaction on Signal Processing, 50(2), 174–188. doi:
10.1109/9780470544198.ch73
Bailey, C., Sutharssan, T., Yin, C., & Stoyanov, S. (2015). Prognostic and health management for engineering systems: a review of the data-driven approach and algorithms. The Journal of Engineering(July). doi:
10.1049/joe.2014.0303
Cadini, F., Sbarufatti, C., Cancelliere, F., & Giglio, M. (2019). State-of-life prognosis and diagnosis of lithium-ion batteries by data-driven particle filters. Applied Energy, 235(June 2018), 661–672. doi:
10.1016/j.apenergy.2018.10.095
Cancelliere, F., Girard, S., Bourinet, J.-M., & Broggi, M. (2023). Grey-box Approach for the Prognostic and Health Management of Lithium-Ion Batteries. Annual Conference of the PHM Society, 15(1), 1–8. doi:
10.36001/phmconf.2023.v15i1.3506
Chang, Y., Fang, H., & Zhang, Y. (2017). A new hybrid method for the prediction of the remaining useful life of a lithium-ion battery. Applied Energy, 206, 15641578. doi: 10.1016/j.apenergy.2017.09.106 Dong, H., Jin, X., Lou, Y., & Wang, C. (2014). Lithium-ion battery state of health monitoring and remaining useful life prediction based on support vector regressionparticle filter. Journal of Power Sources, 271, 114–123. doi: 10.1016/j.jpowsour.2014.07.176 Doucet, A., Godsill, S., & Andrieu, C. (2000). On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing, 10, 197–208. doi:
10.1023/A:1008935410038
Ge, Y., Sun, L., & Ma, J. (2019). An Improved PF Remaining Useful Life Prediction Method Based on Quantum Genetics and LSTM. IEEE Access, 7, 160241–160247. doi: 10.1109/ACCESS.2019.2951197 Hu, X., Xu, L., Lin, X., & Pecht, M. (2020). Battery Lifetime Prognostics. Joule, 4(2), 310–346. doi:
10.1016/j.joule.2019.11.018
Jha, M. S., Bressel, M., Ould-Bouamama, B., & DauphinTanguy, G. (2016). Particle filter based hybrid prognostics of proton exchange membrane fuel cell in bond graph framework. Computers and Chemical Engineering, 95, 216–230. doi:10.1016/j.compchemeng.2016.08.018
Jules, E., Cancelliere, F., Mattrand, C., & Bourinet, J.-M. (2023). Remaining useful life prediction of turbofans with virtual health indicator: A comparison of particle filter-based approaches. , 75-82. doi: 10.1109/ICSRS59833.2023.10381439 Jules, E., Mattrand, C., & Bourinet, J.-M. (2023). Similarity learning for predictive maintenance: health indicator construction based on siamese neural networks and contrastive loss. [Under Review]. Lall, P., Lowe, R., & Goebel, K. (2013). Prognostic health monitoring for a micro-coil spring interconnect subjected to drop impacts. PHM 2013 - 2013 IEEE International Conference on Prognostics and Health Management, Conference Proceedings(June 2013). doi:
Reza, M. S., Mannan, M., Mansor, M., Ker, P. J., Mahlia, T. M., & Hannan, M. A. (2024). Recent advancement of remaining useful life prediction of lithium-ion battery in electric vehicle applications: A review of modelling mechanisms, network configurations, factors, and outstanding issues. Energy Reports, 11(April), 4824–4848. doi: 10.1016/j.egyr.2024.04.039
Saha, B., & Goebel, K. (2007). Battery Data Set. NASA Ames Prognostics Data Repository.
Sbarufatti, C., Corbetta, M., Giglio, M., & Cadini, F. (2018). Adaptive prognosis of lithium-ion batteries based on the combination of particle filters and radial basis function neural networks. Journal of Power Sources, 344, 128–140. doi: 10.1016/j.jpowsour.2017.01.105
10.1109/ICPHM.2013.6621458
Langlois Raphael, R. J., Coret Michel. (2018, November). Fatigue Crack Propagation Benchmark, GDR 3651 FATACRACK. Retrieved from https://doi.org/10.5281/zenodo.1478472 doi: 10.5281/zenodo.1478472 Li, T., Chen, J., Yuan, S., Zarouchas, D., Sbarufatti, C., & Cadini, F. (2024). Particle filterbased fatigue damage prognosis by fusing multiple degradation models. Structural Health Monitoring, 0(0), 14759217231216697. doi:
Vanem, E., Liang, Q., Ferreira, C., Agrell, C., Karandikar, N., Wang, S., . . . Kandepu, R. (2023). Data-Driven Approaches to Diagnostics and State of Health Monitoring of Maritime Battery Systems. Annual Conference of the PHM Society, 15(1), 1–17. doi: 10.36001/phmconf.2023.v15i1.3437
Wang, S., Jin, S., Deng, D., & Fernandez, C. (2021). A Critical Review of Online Battery Remaining Useful Lifetime Prediction Methods. Frontiers in Mechanical Engineering, 7(August), 1–19. doi: 10.3389/fmech.2021.719718
10.1177/14759217231216697
Ma, X., Karkus, P., Hsu, D., & Lee, W. S. (2020). Particle filter recurrent neural networks. AAAI 2020 - 34th AAAI Conference on Artificial Intelligence, 5101–5108. doi:
10.1609/aaai.v34i04.5952
Zio, E. (2022). Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice. Reliability Engineering and System Safety, 218(PA), 108119. doi: 10.1016/j.ress.2021.108119
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
The Prognostic and Health Management Society advocates open-access to scientific data and uses a Creative Commons license for publishing and distributing any papers. A Creative Commons license does not relinquish the author’s copyright; rather it allows them to share some of their rights with any member of the public under certain conditions whilst enjoying full legal protection. By submitting an article to the International Conference of the Prognostics and Health Management Society, the authors agree to be bound by the associated terms and conditions including the following:
As the author, you retain the copyright to your Work. By submitting your Work, you are granting anybody the right to copy, distribute and transmit your Work and to adapt your Work with proper attribution under the terms of the Creative Commons Attribution 3.0 United States license. You assign rights to the Prognostics and Health Management Society to publish and disseminate your Work through electronic and print media if it is accepted for publication. A license note citing the Creative Commons Attribution 3.0 United States License as shown below needs to be placed in the footnote on the first page of the article.
First Author et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 United States License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.