This paper presents an anomaly detection module that uses information-theoretic measures to generate a fault indicator from a particle-filtering-based estimate of the posterior state pdf of a dynamic system. The selected measure allows isolating events where the particle filtering algorithm is unable to track the process measurements using a predetermined state transition model, which translates into either a sudden or a steady increment in the differential entropy of the state pdf estimate (evidence of an anomaly on the system). Anomaly detection is carried out by setting a threshold for the entropy value. Actual data illustrating aging of an energy storage device (specifically battery state- of-health (SOH) measurements [A-h]) are used to test and validate the proposed framework.
How to Cite
anomaly detection, information theory, particle filtering
Andrieu, C., A. Doucet, E. Punskaya, (2001). “Sequential Monte Carlo Methods for Optimal Filtering,” in Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds. NY: Springer-Verlag.
Arulampalam, M.S., S. Maskell, N. Gordon, T. Clapp, (2002). “A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking,” IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 174 – 188.
Ayhan, B., M.Y. Chow, M.H. Song, (2006). “Multiple discriminant analysis and neural network based monolith and partition fault detection schemes for broken rotor bar in induction motors,” IEEE T. Industrial Electronics, Vol. 53, No. 4, pp 1298-1308.
Boers, Y ., J.N. Driessen, A. Bagchi, and P .K. Mandal, (2010). “Particle Filter Based Entropy,” Proceedings of FUSION 2010, Edinburgh, UK.
Cover, T., and J. Thomas, (1991). “Element of Information Theory,” Wiley Interscience, New York, 1991.
Doucet, A., (1998). “On sequential Monte Carlo methods for Bayesian Filtering,” Technical Report, Engineering Department, Univ. Cambridge, UK.
Doucet, A., N. de Freitas, N. Gordon, (2001). “An introduction to Sequential Monte Carlo methods,” in Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds. NY: Springer-Verlag.
Ibrahim, A., M. El Badaoui, F. Guillet, F. Bonnardot, (2008). “A new bearing fault detection method in induction machine based on instantaneous power factor,” IEEE T. Industrial Electronics, Vol. 55, No. 12, pp 4252-4259.
Isermann, R., and P. Balle, (1997). “Trends in the Application of Model-Based Fault Detection and Diagnosis of Technical Processes,” Control Eng. Practice, vol. 5, no. 5, pp. 709-719.
Kadirkamanathan, V., P. Li, M.H. Jaward, and S.G. Fabri, (2002). “Particle filtering-based fault detection in nonlinear stochastic systems,” International Journal of Systems Science, 33(4), pp. 259-265.
Khan, M. and M. Rahman, (2009). “Development and implementation of a novel fault diagnostic and protection technique for IPM motor drivers,” IEEE T. Industrial Electronics, Vol. 56, No. 1, pp. 85-92.
Lanz, O., (2007). “An information theoretic rule for sample size adaptation in particle filtering,” Proceedings of the 14th International Conference on Image Analysis and Processing (ICIAP), pp. 317–322.
Liverani, S., and A. Papavasiliou, (2006). “Entropy Based Adaptive Particle Filter,” 2006 IEEE Nonlinear Statistical Signal Processing Workshop.
Orchard, M., G. Kacprzynski, K. Goebel, B. Saha, G. Vachtsevanos, (2008). “Advances in Uncertainty Representation and Management for Particle Filtering Applied to Prognostics,” 2008 International Conference on Prognostics and Health Management PHM 2008, Denver, CO, USA.
Orchard, M., (2009). On-line Fault Diagnosis and Failure Prognosis Using Particle Filters. Theoretical Framework and Case Studies, Publisher: VDM Verlag Dr. Müller Aktiengesellschaft & Co. KG, Saarbrücken, Germany, 108 pages. Atlanta: The Georgia Institute of Technology, Diss., 2007.
Orchard, M. and G. Vachtsevanos, (2009). “A Particle Filtering Approach for On-Line Fault Diagnosis and Failure Prognosis,” Transactions of the Institute of Measurement and Control, vol. 31, no. 3-4, pp. 221- 246.
Orchard, M., L. Tang, K. Goebel, G. Vachtsevanos, (2009). “A Novel RSPF Approach to Prediction of High-Risk, Low-Probability Failure Events,” First Annual Conference of the Prognostics and Health Management Society, San Diego, CA, USA.
Orchard, M., Tang, L., Saha, B., Goebel, K., and V achtsevanos, G., (2010). “Risk-Sensitive Particle- Filtering-based Prognosis Framework for Estimation of Remaining Useful Life in Energy Storage Devices,” Studies in Informatics and Control, vol. 19, Issue 3, pp. 209-218.
Orchard, M., L. Tang, and G. Vachtsevanos, (2011). “A Combined Anomaly Detection and Failure Prognosis Approach for Estimation of Remaining Useful Life in Energy Storage Devices,” Annual Conference of the Prognostics and Health Management Society 2011, Montreal, QB, Canada.
Orguner, U., (2009). “Entropy Calculation in Particle Filters,” Signal Processing and Communications Applications Conference.
Ryan, A., (2008). “Information-theoretic tracking control based on particle filter estimate,” AIAA Guidance Navigation and Control Conference
Skoglar, P., U. Orguner, and F. Gustafsson, (2009). “On information measures based on particle mixture for optimal bearings-only tracking,” Proceedings of IEEE Aerospace Conference 2009, Big Sky, Montana, USA
Tolani, D., M. Yasar, S. Chin, A. Ray, (2005). “Anomaly Detection for Health Management of Aircraft Gas Turbine Engines,” 2005 American Control Conference, pp. 459-464, Portland, OR, USA.
Verma, V., G. Gordon, R. Simmons, S. Thrun, (2004). “Particle Filters for Rover Fault Diagnosis,” IEEE Robotics & Automation Magazine, pp. 56 – 64.
Zhang, B., T. Khawaja, R. Patrick, M. Orchard, A. Saxena, G. Vachtsevanos, (2009). “A Novel Blind Deconvolution De-Noising Scheme in Failure Prognosis,” IEEE Transactions on Instrumentation and Measurement, vol. 58, no. 2, pp. 303-310.
Zhang, B., C. Sconyers, C. Byington, R. Patrick, M. Orchard, and G. Vachtsevanos, (2011). “A Probabilistic Fault Detection Approach: Application to Bearing Fault Detection,” IEEE Transactions on Industrial Electronics, vol. 58, no. 5, pp. 2011-2018.
Zhou, W., T. Habetler, R. Harley, (2008). “Bearing fault detection via stator current noise cancellation and statistical control,” IEEE T. Industrial Electronics, Vol. 55, No. 12, pp 4260-4269, Dec. 2008.
The Prognostic and Health Management Society advocates open-access to scientific data and uses a Creative Commons license for publishing and distributing any papers. A Creative Commons license does not relinquish the author’s copyright; rather it allows them to share some of their rights with any member of the public under certain conditions whilst enjoying full legal protection. By submitting an article to the International Conference of the Prognostics and Health Management Society, the authors agree to be bound by the associated terms and conditions including the following:
As the author, you retain the copyright to your Work. By submitting your Work, you are granting anybody the right to copy, distribute and transmit your Work and to adapt your Work with proper attribution under the terms of the Creative Commons Attribution 3.0 United States license. You assign rights to the Prognostics and Health Management Society to publish and disseminate your Work through electronic and print media if it is accepted for publication. A license note citing the Creative Commons Attribution 3.0 United States License as shown below needs to be placed in the footnote on the first page of the article.
First Author et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 United States License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.