Coupling a Dynamic Linear Model with Random Forest Regression to Estimate Engine Wear
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
Mechanical systems wear or change over time. Data collected over a system’s life can be input to statistical learning models to predict this wear/change. A research effort at The Boeing Company has modeled gas turbine engine exhaust gas temperature (EGT) as a function of other recorded parameters. Our investigation chose gas turbines, but these techniques could also be used for other systems that slowly change (degrade) over time. Previous work trained a flexible empirical regression model at a fixed point of wear, and then applied it independently at time points over the life of an engine to predict wear. However, wear typically occurs slowly and smoothly. This paper describes the benefit of relating wear predictions over time using a dynamic linear model, which is an example of a state space method. The combined model predicts wear with dramatically reduced variability over both our previous effort and a baseline method. The benefit of reduced variability is that engine wear is more evident, and it is possible to detect operational anomalies more quickly. In addition to tracking wear, we also use the model as the basis for a Bayesian approach to monitor for sudden changes and reject outliers, and adapt the model after these events. Experiments compare methods and give some guidance in applying the methodology.
How to Cite
##plugins.themes.bootstrap3.article.details##
regression, State Space, Exhaust Gas Temperature, normalization, random forest, dynamic linear model
Basu, S. and Farner, S. and Schimert, J. and Wineland, A. (2008b). "Regression-Based Method for Predicting Engine Wear from Exhaust Gas Temperature", Prognostics and Health Management Conference, Denver, CO.
Breiman, L. and Friedman, J. and Olshen, R. and Stone, C. (1984), Classification and Regression Trees, Wadsworth, Monterey, CA.
Breiman, L. (1996), "Bagging predictors", Machine Learning, volume 26, Pages 123—140.
Breiman, L. (2001a), "Random Forests", Machine Learning, volume 45, number 1, pages 5-32.
Breiman, L. (2001b), "Statistical modeling: The two cultures (with discussion)", Statistical Science, volume 16, number 3, pages 199—231.
Bühlmann, P. and Hothorn, T. (2007). Boosting algorithms: regularization, prediction and model fitting. Statistical Science, 22(4):477-505.
Doucet, A. (Editor) and de Freitas, N. (Editor) and Gordon, N. (Editor), (2001). "Sequential Monte Carlo Methods in Practice, Springer.
Hall, D.L. and McMullen, S.A.H. (2004). “Mathematical Techniques in Multisensor Data Fusion”, Artech House Information Warfare Library.
Friedman, J.H (2001), "Greedy function approximation: A gradient boosting machine", Annals of Statistics, volume 29, pages 1189—1202.
Liaw, A. and Wiener, M. (2002). Classification and Regression by randomForest. R News 2(3), 18--22.
Liggins, M. E., Hall, D. L., Llinas, J. (Editors) (2009) "Handbook of Multisensor Data Fusion: Theory and Practice," 2nd Edition, CRC Press, New York.
Murua, A (2002), "Upper bounds for error rates associated to linear combination of classifiers", IEEE Transactions on Pattern Analysis and Machine Intelligence.
Parikh D. and Polikar R. (2007), “An Ensemble based incremental learning approach to data fusion”, IEEE Transactions on Systems, Man and Cybernetics – Part B: Cybernetics, vol. 37, No. 2.
Giovanni Petris (2010). dlm: Bayesian and Likelihood Analysis of Dynamic Linear Models. R package version 1.1-1.
Petris, G. and Petrone, S. and Campagnoli, P. (2009) "Dynamic Linear Models with R", Springer.
Pole, A. and West, M. and Harrison, J. (1994). Applied Bayesian Forecasting and Time Series Analysis, Chapman & Hall.
R Development Core Team (2009). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3- 900051-07-0, URL http://www.R-project.org.
Schapire, R.E. (2003). The boosting approach to machine learning: An overview. In D. D. Denison, M. H. Hansen, C. Holmes, B. Mallick, B. Yu, editors, Nonlinear Estimation and Classification. Springer.
Schwabacher, M. and Kai Goebel, K. A Survey of Artificial Intelligence for Prognostics. NASA Ames Research Center. MS 269-3. http://ic.arc.nasa.gov/people/schwabac/FS02Schwab acherM.pdf.
Sinhaa, A. and Chenb, H. and Danua, D. G. and Kirubarajana, T. and Farooqc, M. (2008), "Estimation and Decision Fusion: A Survey," Neurocomputing Volume 71, Issues 13-15, pages 2650-2656,
West, M. (1986). Bayesian Model Monitoring”, Journal of the Royal Statistical Society, Series B, volume = 48, pages= 70—78.
West, M. and Harrison, J. (1986). “Monitoring and Adaptation in Bayesian Forecasting Models", Journal of the American Statistical Association, Vol. 81, No. 395, pages 741-750.
West, M. and Harrison, J. (1999). “Bayesian Forecasting and Dynamic Models", Springer.
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
The Prognostic and Health Management Society advocates open-access to scientific data and uses a Creative Commons license for publishing and distributing any papers. A Creative Commons license does not relinquish the author’s copyright; rather it allows them to share some of their rights with any member of the public under certain conditions whilst enjoying full legal protection. By submitting an article to the International Conference of the Prognostics and Health Management Society, the authors agree to be bound by the associated terms and conditions including the following:
As the author, you retain the copyright to your Work. By submitting your Work, you are granting anybody the right to copy, distribute and transmit your Work and to adapt your Work with proper attribution under the terms of the Creative Commons Attribution 3.0 United States license. You assign rights to the Prognostics and Health Management Society to publish and disseminate your Work through electronic and print media if it is accepted for publication. A license note citing the Creative Commons Attribution 3.0 United States License as shown below needs to be placed in the footnote on the first page of the article.
First Author et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 United States License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.