Deep Health Indicator Extraction: A Method based on Auto-encoders and Extreme Learning Machines



Yang Hu Thomas Palmé Olga Fink


In this paper, we propose a novel deep learning method for feature extraction in prognostics and health management applications. The proposed method is based on Extreme Learning Machines (ELM) and Auto-Encoders (AE), which have demonstrated very good performance and very short training time compared to other deep learning methods on several applications, including image recognition problems. The proposed approach is applied to vibration condition monitoring data to extract features from normal operation (i.e. fault free conditions) without any additional expert knowledge or prior information on the type of signals and the information content in the datasets. The approach demonstrates a better performance in terms of trendability and monotonicity compared to commonly applied feature extraction methods.

How to Cite

Hu, Y., Palmé, T., & Fink, O. (2016). Deep Health Indicator Extraction: A Method based on Auto-encoders and Extreme Learning Machines. Annual Conference of the PHM Society, 8(1).
Abstract 18 | PDF Downloads 27



Bearing, deep learning, feature learning, Extreme Learning Machines, Stacked Auto-Encoders

Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8), 1798–1828.
Benkedjouh, T., Medjaher, K., Zerhouni, N., & Rechak, S. (2013). Remaining useful life estimation based on nonlinear feature reduction and support vector regression. Engineering Applications of Artificial Intelligence, 26(7), 1751–1760.
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2015). Recent advances and emerging challenges of feature selection in the context of big data. Knowledge-Based Systems, 86, 33–45.
Cambria, E., Huang, G.-B., Kasun, L. L. C., Zhou, H., Vong, C. M., Lin, J., … Liu, J. (2013). Extreme Learning Machines [Trends & Controversies]. IEEE Intelligent Systems, 28(6), 30–59.
Emmanouilidis, C., Hunter, A., MacIntyre, J., & Cox, C. (1999). Selecting features in neurofuzzy modeling by multiobjective genetic algorithms. Artificial Neural Networks, 1999. ICANN 99. Ninth International Conference on (Conf. Publ. No. 470).
Fan, W., Cai, G., Zhu, Z. K., Shen, C., Huang, W., & Shang, L. (2015). Sparse representation of transients in wavelet basis and its application in gearbox fault feature extraction. Mechanical Systems and Signal Processing, 56, 230–245.
Gan, M., Wang, C., & Zhu, C. (2016). Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mechanical Systems and Signal Processing, 72, 92–104.
Gowid, S., Dixon, R., & Ghani, S. (2015). A novel robust automated FFT-based segmentation and features selection algorithm for acoustic emission condition based monitoring systems. Applied Acoustics, 88, 66–74.
Huang, G. Bin. (2015). What are Extreme Learning Machines? Filling the Gap Between Frank Rosenblatt’s Dream and John von Neumann’s Puzzle. Cognitive Computation, 7(3), 263–278.
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012). Extreme Learning Machine for Regression and Multiclass Classification. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 42(2), 513–529.
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2004). Extreme learning machine: a new learning scheme of feedforward neural networks. In Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on (Vol. 2, pp. 985–990 vol.2).
Jia, F., Lei, Y., Lin, J., Zhou, X., & Lu, N. (2016). Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mechanical Systems and Signal Processing, 72, 303–315.
Lee, J., Wu, F., Zhao, W., Ghaffari, M., Liao, L., & Siegel, D. (2014). Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications. Mechanical Systems and Signal Processing, 42(1), 314–334.
Lei, Y., & Zuo, M. J. (2009). Gear crack level identification based on weighted K nearest neighbor classification algorithm. Mechanical Systems and Signal Processing, 23(5), 1535–1547.
Lemos, A., Caminhas, W., & Gomide, F. (2013). Adaptive fault detection and diagnosis using an evolving fuzzy classifier. Information Sciences, 220, 64–85.
Mavromatidis, G., Acha, S., & Shah, N. (2013). Diagnostic tools of energy performance for supermarkets using Artificial Neural Network algorithms. Energy and Buildings, 62, 304–314.
Medjaher, K., Tobon-Mejia, D. a, & Zerhouni, N. (2012). Remaining Useful Life Estimation of Critical Components With Application to Bearings. IEEE Transactions on Reliability, 61(2), 292–302.
Ming, A. B., Zhang, W., Qin, Z. Y., & Chu, F. L. (2016). Fault feature extraction and enhancement of rolling element bearing in varying speed condition. Mechanical Systems and Signal Processing, 76, 367–379.
Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B., Zerhouni, N., & Varnier, C. (2012). PRONOSTIA : An experimental platform for bearings accelerated degradation tests.
Pan, J., Chen, J., Zi, Y., Li, Y., & He, Z. (2016). Mono-component feature extraction for mechanical fault diagnosis using modified empirical wavelet transform via data-driven adaptive Fourier spectrum segment. Mechanical Systems and Signal Processing, 72, 160–183.
Rai, A., & Upadhyay, S. H. (2016). A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings. Tribology International, 96, 289–306.
Randall, R. B., & Antoni, J. (2011). Rolling element bearing diagnostics-A tutorial. Mechanical Systems and Signal Processing, 25(2), 485–520.
Selak, L., Butala, P., & Sluga, A. (2014). Condition monitoring and fault diagnostics for hydropower plants. Computers in Industry, 65(6), 924–936.
Shao, M., Zhu, X.-J., Cao, H.-F., & Shen, H.-F. (2014). An artificial neural network ensemble method for fault diagnosis of proton exchange membrane fuel cell system. Energy, 67, 268–275.
Tamilselvan, P., & Wang, P. (2013). Failure diagnosis using deep belief learning based health state classification. Reliability Engineering & System Safety, 115(0), 124–135.
Yan, W., Qiu, H., & Iyer, N. (2008). Feature extraction for bearing prognostics and health management (phm)-a survey (preprint). DTIC Document.
Yan, W., & Yu, L. (2015). On Accurate and Reliable Anomaly Detection for Gas Turbine Combustors: A Deep Learning Approach. Proceedings of the Annual Conference of the.
Yang, Y., Liao, Y., Meng, G., & Lee, J. (2011). A hybrid feature selection scheme for unsupervised learning and its application in bearing fault diagnosis. Expert Systems with Applications, 38(9), 11311–11320.
Technical Papers