A Survey of Health Management User Objectives in Aerospace Systems Related to Diagnostic and Prognostic Metrics
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Published
Mar 22, 2021
Kevin R. Wheeler
Tolga Kurtoglu
Scott D. Poll
Abstract
One of the most prominent technical challenges to effective deployment of health management systems is the vast difference in user objectives with respect to engineering development. In this paper, a detailed survey on the objectives of different users of health management systems is presented. These user objectives are then mapped to the metrics typically encountered in the development and testing of two main systems health management functions: diagnosis and prognosis. Using this mapping, the gaps between user goals and the metrics associated with diagnostics and prognostics are identified and presented with a collection of lessons learned from previous studies that include both industrial and military aerospace applications.
##plugins.themes.bootstrap3.article.details##
Keywords
diagnosis, prognostics, health management, user requirements
References
10303-1, "Industrial automation systems and integration - Product data representation and exchange Part 1: Overview and fundamental principles." 1994.
I. 1636.1, "IEEE Trial-Use Standard for Software Interface for Maintenance Information Collection and Analysis (SIMICA): Exchanging Test Results and Session Information via the eXtensible Markup Language (XML)," February, 2008.
I. S. 1671.4, "IEEE Trial-Use Standard for Automatic Test Markup Language (ATML) for Exchanging Automatic Test Information via XML: Exchanging Test Configuration Information," April, 2008.
"727 to 787: Evolution of Aircraft Maintenance Systems," Avionics Magazine Special Report:http://www.aviationtoday.com/Assets/Honeyw ellsmall.pdf, 2007.
"DoD Architectural Framework: Vol. 1: Definitions and Guidelines, Vol. 2:Product Descriptions, Vol.3: Architecture Data Description," April, 2007.
Abderrahman A., M. Sawan, Y. Savaria, and A. Khouas, "New Analog Test Metrics Based on Probabilistic and Deterministic Combination Approaches," in 14th IEEE International Conference on Electronics, Circuits and Systems, 2007, pp. 82-85.
Albert A.P., E. Antoniou, S. D. Leggiero, K. A. Tooman, and R. L. Veglio, "A Systems Engineering Approach to Integrated Structural Health Monitoring for Aging Aircraft," Wright-Patterson Air Force Base, Ohio, 2006.
Alford R., "Data Management as the Key to Prognostic Capability," in SAE doD Maintenance Symposium \& Exhibition, 2007.
Ashby M.J. and R. J. Byer, "An Approach for Conducting a Cost Benefit Analysis of Aircraft Engine Prognostics and Health management Functions," in IEEE Aerospace Conference
Proceedings. vol. 6, 2002, pp. 2847-2856.
Bain K. and D. G. Orwig, "F/A-18E/F Built-in-test (BIT) Maturation Process," National Defense Industrial Associated 3rd Annual systems Engineering & Supportability Conference, October, 2000.
Banks J. and J. Merenich, "Cost Benefit Analysis for Asset Health Management Technology," in IEEE Annual Reliability and Maintainability Symposium, 2007, pp. 95-100.
Banks J., K. Reichard, E. Crow, and E. Nickell, "How Engineers Can Conduct Cost-Benefit Analysis for PHM Systems," in IEEE Aerospace Conference, 2005, pp. 3958-3967.
Boller C., "Ways and Options for Aircraft Structural Health Management," in Smart Materials and Structures. vol. 10, 2001, pp. 432-440.
Byer B., A. Hess, and L. Fila, "Writing a Convincing Cost Benefit Analysis to Substantiate Autonomic Logistics," in IEEE Aerospace Conference. vol. 6, 2001, pp. 3095-3103.
Collins J.H. and G. Edwards, "The Naval Air Systems Command's Initiatives for Aircraft Wiring Diagnostic Support Equipment for Multiple Maintenance Levels," Naval Air Systems Command, 2005.
Crow E., "Condition Based Maintenance, the Maintenance Execution Process and the Open Systems Standards, An Overview of Activities at Penn State," in Defense Maintenance Conference Reno, Nevada, 2006.
Hecht H., "Prognostics for Electronic Equipment: An Economic Perspective," in IEEE Reliability and Maintainability Symposium, 2006, pp. 165-168.
Hess A. and L. Fila, "Prognostics, from the Need to Reality - from the Fleet Users and PHM System Designer/Developers Perspectives," in IEEE Aerospace Conference. vol. 6, 2002, pp. 2791-2797.
Hess A., G. Calvello, and P. Frith, "Challenges, Issues, and Lessons Learned Chasing the Big P: Real Predictive Prognostics Part 1," in IEEE Aerospace Conference, 2005, pp. 3610-3619.
Hess A., G. Calvello, and T. Dabney, "PHM a Key Enabler for the JSF Autonomic Logistics Support Concept," in IEEE Aerospace Conference, 2004, pp. 3543-3550.
Hoyle C., A. F. Mehr, I. Y. Tumer, and W. Chen, "Cost- Benefit Quantification of ISHM in Aerospace Systems," ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, September 4-7, 2007 2007.
Kacprzynski G.J., A. Liberson, A. Palladino, M. J. Roemer, A. J. Hess, and M. Begin, "Metrics and Development Tools for Prognostic Algorithms," in IEEE Aerospace Conference, 2004, pp. 3809-3815.
Kurtoglu T., O. J. Mengshoel, and S. Poll, "A Framework for Systematic Benchmarking of Monitoring and Diagnostic Systems," IEEE International Conference on Prognostics and Health Management, October 6-9, 2008.
Leao B.P., T. Yoneyama, G. C. Rocha, and K. T. Fitzgibbon, "Prognostics Performance Metrics and their Relation to Requirements, Design, Verification and Cost-Benefit," IEEE International Conference on Prognostics and Health Management, 2008.
Line J.K. and N. S. Clements, "Prognostics Usefulness Criteria," in IEEE Aerospace Conference, 2006.
MacConnell J.H., "ISHM & Design: A review of the benefits of the ideal ISHM system," in IEEE Aerospace Conference, 2007.
Marz T.F., "Integrated Diagnostics: Operational Missions, Diagnostic Types, Characteristics, and Capability Gaps," 2005.
Millar R.C., "A Systems Engineering Approach to PHM for Military Aircraft Propulsion Systems," in IEEE Aerospace Conference, 2007. KIF, "Knowledge Interchange Format, Working draft of proposed American national standard," vol. Document No. X3T2/98-004, 1998.
Nenninger G., "Aviation Condition Based Maintenance (CBM)," in DoD Maintenance Symposium \& Exhibition, 2007.
Novis A. and H. Powrie, "PHM Sensor Implementation in the Real World - a Status Report," in IEEE Aerospace Conference, 2006.
Ofsthun S., "Integrated Vehicle Health Management for Aerospace Platforms," IEEE Instrumentation & Measurement Magazine, pp. 21-24, September, 2002 2002.
Pritchett A.R., B. Vandor, and K. Edwards, "Testing and Implementing cockpit Alerting systems," in Reliability Engineering and System Safety. vol. 75, 2002, pp. 193-206.
Saxena A., J. Celaya, E. Balaban, K. Goebel, B. Saha, S. Saha, and M. Schwabacher, "Metrics for Evaluating Performance of Prognostic Techniques," IEEE International Conference on
Prognostics and Health Management, October 6-9, 2008.
Scandura P.A., "Integrated Vehicle health Management as a System Engineering Discipline," in The 24th Digital Avionics Systems Conference. vol. 2, 2005.
Sheppard J..W. and T. J. Wilmering, "Recent Advances in IEEE Standards for Diagnosis and Diagnostic Maturation," in IEEE Aerospace Conference, 2006.
Sheppard J.W. and M. A. Kaufman, "IEEE Information Modeling Standards for Test and Diagnosis," in 5th Annual Joint Aerospace Weapon System Support, Sensors and Simulation Symposium San Diego, CA, 1999.
Song L. and J. K. Kuchar, "Dissonance Between Multiple Alerting Systems Part I: Modeling and Analysis," in IEEE Transactions on Systems, man, and Cybernetics-Part A: Systems and Humans. vol. 33, 2003.
Vincent B. and A. R. Pritchett, "Requirements Specification for Health Monitoring Systems Capable of Resolving flight Control System Faults," in The 20th Conference Digital Avionics Systems. vol. 1, 2001, pp. 3D4/1 - 3D4/8.
Westervelt K., "Fixing BIT on the V-22 Osprey," IEEE Aerospace Conference, March, 2006.
Wilmering T.J., "When Good Diagnostics Go Bad - Why Maturation is Still Hard," in IEEE Aerospace Conference. vol. 7, 2003, pp. 3137-3147.
Yukish M., C. Byington, and R. Campbell, "Issues in the Design and Optimization of Health Management Systems," in New Frontiers in Integrated Diagnostics and Prognostics, Proceedings of the 55th Meeting of the Society for Machinery Failure Prevention Technology Virginia Beach, Virginia, 2001.
Zhang S., R. Kang, X. He, and M. G. Pecht, "China's Efforts in Prognostics and Health Management," in IEEE Transactions on Components and Packaging Technologies. vol. 31, 2008.
I. 1636.1, "IEEE Trial-Use Standard for Software Interface for Maintenance Information Collection and Analysis (SIMICA): Exchanging Test Results and Session Information via the eXtensible Markup Language (XML)," February, 2008.
I. S. 1671.4, "IEEE Trial-Use Standard for Automatic Test Markup Language (ATML) for Exchanging Automatic Test Information via XML: Exchanging Test Configuration Information," April, 2008.
"727 to 787: Evolution of Aircraft Maintenance Systems," Avionics Magazine Special Report:http://www.aviationtoday.com/Assets/Honeyw ellsmall.pdf, 2007.
"DoD Architectural Framework: Vol. 1: Definitions and Guidelines, Vol. 2:Product Descriptions, Vol.3: Architecture Data Description," April, 2007.
Abderrahman A., M. Sawan, Y. Savaria, and A. Khouas, "New Analog Test Metrics Based on Probabilistic and Deterministic Combination Approaches," in 14th IEEE International Conference on Electronics, Circuits and Systems, 2007, pp. 82-85.
Albert A.P., E. Antoniou, S. D. Leggiero, K. A. Tooman, and R. L. Veglio, "A Systems Engineering Approach to Integrated Structural Health Monitoring for Aging Aircraft," Wright-Patterson Air Force Base, Ohio, 2006.
Alford R., "Data Management as the Key to Prognostic Capability," in SAE doD Maintenance Symposium \& Exhibition, 2007.
Ashby M.J. and R. J. Byer, "An Approach for Conducting a Cost Benefit Analysis of Aircraft Engine Prognostics and Health management Functions," in IEEE Aerospace Conference
Proceedings. vol. 6, 2002, pp. 2847-2856.
Bain K. and D. G. Orwig, "F/A-18E/F Built-in-test (BIT) Maturation Process," National Defense Industrial Associated 3rd Annual systems Engineering & Supportability Conference, October, 2000.
Banks J. and J. Merenich, "Cost Benefit Analysis for Asset Health Management Technology," in IEEE Annual Reliability and Maintainability Symposium, 2007, pp. 95-100.
Banks J., K. Reichard, E. Crow, and E. Nickell, "How Engineers Can Conduct Cost-Benefit Analysis for PHM Systems," in IEEE Aerospace Conference, 2005, pp. 3958-3967.
Boller C., "Ways and Options for Aircraft Structural Health Management," in Smart Materials and Structures. vol. 10, 2001, pp. 432-440.
Byer B., A. Hess, and L. Fila, "Writing a Convincing Cost Benefit Analysis to Substantiate Autonomic Logistics," in IEEE Aerospace Conference. vol. 6, 2001, pp. 3095-3103.
Collins J.H. and G. Edwards, "The Naval Air Systems Command's Initiatives for Aircraft Wiring Diagnostic Support Equipment for Multiple Maintenance Levels," Naval Air Systems Command, 2005.
Crow E., "Condition Based Maintenance, the Maintenance Execution Process and the Open Systems Standards, An Overview of Activities at Penn State," in Defense Maintenance Conference Reno, Nevada, 2006.
Hecht H., "Prognostics for Electronic Equipment: An Economic Perspective," in IEEE Reliability and Maintainability Symposium, 2006, pp. 165-168.
Hess A. and L. Fila, "Prognostics, from the Need to Reality - from the Fleet Users and PHM System Designer/Developers Perspectives," in IEEE Aerospace Conference. vol. 6, 2002, pp. 2791-2797.
Hess A., G. Calvello, and P. Frith, "Challenges, Issues, and Lessons Learned Chasing the Big P: Real Predictive Prognostics Part 1," in IEEE Aerospace Conference, 2005, pp. 3610-3619.
Hess A., G. Calvello, and T. Dabney, "PHM a Key Enabler for the JSF Autonomic Logistics Support Concept," in IEEE Aerospace Conference, 2004, pp. 3543-3550.
Hoyle C., A. F. Mehr, I. Y. Tumer, and W. Chen, "Cost- Benefit Quantification of ISHM in Aerospace Systems," ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, September 4-7, 2007 2007.
Kacprzynski G.J., A. Liberson, A. Palladino, M. J. Roemer, A. J. Hess, and M. Begin, "Metrics and Development Tools for Prognostic Algorithms," in IEEE Aerospace Conference, 2004, pp. 3809-3815.
Kurtoglu T., O. J. Mengshoel, and S. Poll, "A Framework for Systematic Benchmarking of Monitoring and Diagnostic Systems," IEEE International Conference on Prognostics and Health Management, October 6-9, 2008.
Leao B.P., T. Yoneyama, G. C. Rocha, and K. T. Fitzgibbon, "Prognostics Performance Metrics and their Relation to Requirements, Design, Verification and Cost-Benefit," IEEE International Conference on Prognostics and Health Management, 2008.
Line J.K. and N. S. Clements, "Prognostics Usefulness Criteria," in IEEE Aerospace Conference, 2006.
MacConnell J.H., "ISHM & Design: A review of the benefits of the ideal ISHM system," in IEEE Aerospace Conference, 2007.
Marz T.F., "Integrated Diagnostics: Operational Missions, Diagnostic Types, Characteristics, and Capability Gaps," 2005.
Millar R.C., "A Systems Engineering Approach to PHM for Military Aircraft Propulsion Systems," in IEEE Aerospace Conference, 2007. KIF, "Knowledge Interchange Format, Working draft of proposed American national standard," vol. Document No. X3T2/98-004, 1998.
Nenninger G., "Aviation Condition Based Maintenance (CBM)," in DoD Maintenance Symposium \& Exhibition, 2007.
Novis A. and H. Powrie, "PHM Sensor Implementation in the Real World - a Status Report," in IEEE Aerospace Conference, 2006.
Ofsthun S., "Integrated Vehicle Health Management for Aerospace Platforms," IEEE Instrumentation & Measurement Magazine, pp. 21-24, September, 2002 2002.
Pritchett A.R., B. Vandor, and K. Edwards, "Testing and Implementing cockpit Alerting systems," in Reliability Engineering and System Safety. vol. 75, 2002, pp. 193-206.
Saxena A., J. Celaya, E. Balaban, K. Goebel, B. Saha, S. Saha, and M. Schwabacher, "Metrics for Evaluating Performance of Prognostic Techniques," IEEE International Conference on
Prognostics and Health Management, October 6-9, 2008.
Scandura P.A., "Integrated Vehicle health Management as a System Engineering Discipline," in The 24th Digital Avionics Systems Conference. vol. 2, 2005.
Sheppard J..W. and T. J. Wilmering, "Recent Advances in IEEE Standards for Diagnosis and Diagnostic Maturation," in IEEE Aerospace Conference, 2006.
Sheppard J.W. and M. A. Kaufman, "IEEE Information Modeling Standards for Test and Diagnosis," in 5th Annual Joint Aerospace Weapon System Support, Sensors and Simulation Symposium San Diego, CA, 1999.
Song L. and J. K. Kuchar, "Dissonance Between Multiple Alerting Systems Part I: Modeling and Analysis," in IEEE Transactions on Systems, man, and Cybernetics-Part A: Systems and Humans. vol. 33, 2003.
Vincent B. and A. R. Pritchett, "Requirements Specification for Health Monitoring Systems Capable of Resolving flight Control System Faults," in The 20th Conference Digital Avionics Systems. vol. 1, 2001, pp. 3D4/1 - 3D4/8.
Westervelt K., "Fixing BIT on the V-22 Osprey," IEEE Aerospace Conference, March, 2006.
Wilmering T.J., "When Good Diagnostics Go Bad - Why Maturation is Still Hard," in IEEE Aerospace Conference. vol. 7, 2003, pp. 3137-3147.
Yukish M., C. Byington, and R. Campbell, "Issues in the Design and Optimization of Health Management Systems," in New Frontiers in Integrated Diagnostics and Prognostics, Proceedings of the 55th Meeting of the Society for Machinery Failure Prevention Technology Virginia Beach, Virginia, 2001.
Zhang S., R. Kang, X. He, and M. G. Pecht, "China's Efforts in Prognostics and Health Management," in IEEE Transactions on Components and Packaging Technologies. vol. 31, 2008.
Section
Technical Papers