Continuous Test-time Domain Adaptation for Efficient Fault Detection under Evolving Operating Conditions

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Jun 27, 2024
HAN SUN Kevin Ammann Stylianos Giannoulakis Olga Fink

Abstract

Fault detection is crucial in industrial systems to prevent failures and optimize performance by distinguishing abnormal from normal operating conditions. Data-driven methods have been gaining popularity for fault detection tasks as the amount of condition monitoring data from complex industrial systems increases. Despite these advances, early fault detection remains a challenge under real-world scenarios. The high variability of operating conditions and environments makes it difficult to collect comprehensive training datasets that can represent all possible operating conditions, especially in the early stages of system operation. Furthermore, these variations often evolve over time, potentially leading to entirely new data distributions in the future that were previously unseen. These challenges prevent direct knowledge transfer across different units and over time, leading to the distribution gap between training and testing data and inducing performance degradation of those methods in real-world scenarios. To overcome this, our work introduces a novel approach for continuous test-time domain adaptation. This enables early-stage robust anomaly detection by addressing domain shifts and limited data representativeness issues. We propose a Test-time domain Adaptation Anomaly Detection (TAAD) framework that separates input variables into system parameters and measurements, employing two domain adaptation modules to independently adapt to each input category. This method allows for effective adaptation to evolving operating conditions and is particularly beneficial in systems with scarce data. Our approach, tested on a real-world pump monitoring dataset, shows significant improvements over existing domain adaptation methods in fault detection, demonstrating enhanced accuracy and reliability.

How to Cite

SUN, H., Ammann, K. ., Giannoulakis, S. ., & Fink, O. . (2024). Continuous Test-time Domain Adaptation for Efficient Fault Detection under Evolving Operating Conditions. PHM Society European Conference, 8(1), 11. https://doi.org/10.36001/phme.2024.v8i1.4021
Abstract 218 | PDF Downloads 148

##plugins.themes.bootstrap3.article.details##

Keywords

Test-time, domain adaptation, fault detection

References
Fink, O., Wang, Q., Svensen, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020). Potential, challenges and future directions for deep learning in prognostics and health management applications. Engineering Applications of Artificial Intelligence, 92, 103678. Hu, Z., Zhao, H., & Peng, J. (2022). Low-rank reconstruction-based autoencoder for robust fault detection. Control Engineering Practice, 123, 105156. Lai, K.-H., Wang, L., Chen, H., Zhou, K., Wang, F., Yang, H., & Hu, X. (2023). Context-aware domain adaptation for time series anomaly detection. In Proceedings of the 2023 siam international conference on data mining (sdm) (pp. 676–684). Leone, G., Cristaldi, L., & Turrin, S. (2016). A data-driven prognostic approach based on sub-fleet knowledge extraction. In 14th imeko tc10 workshop on technical diagnostics: New perspectives in measurements, tools and techniques for systems reliability, maintainability and safety (pp. 417–422). Leone, G., Cristaldi, L., & Turrin, S. (2017). A data-driven prognostic approach based on statistical similarity: An application to industrial circuit breakers. Measurement, 108, 163–170. Liang, J., Hu, D., & Feng, J. (2020). Do we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation. In International conference on machine learning (pp. 6028–6039). Liu, L., Tan, E., Zhen, Y., Yin, X. J., & Cai, Z. Q. (2018). Ai-facilitated coating corrosion assessment system for productivity enhancement. In 2018 13th ieee conference on industrial electronics and applications (iciea) (pp. 606–610). Michau, G., & Fink, O. (2019). Unsupervised fault detection

in varying operating conditions. In 2019 ieee international conference on prognostics and health management (icphm) (pp. 1–10).

Michau, G., & Fink, O. (2021). Unsupervised transfer learning for anomaly detection: Application to complementary operating condition transfer. Knowledge-Based Systems, 216, 106816.

Michau, G., Palm´e, T., & Fink, O. (2018). Fleet phm for critical systems: bi-level deep learning approach for fault detection. In Proceedings of the european conference of the phm society 2018 (Vol. 4, p. 403).

Nejjar, I., Geissmann, F., Zhao, M., Taal, C., & Fink, O.

(2024). Domain adaptation via alignment of operation profile for remaining useful lifetime prediction. Reliability Engineering & System Safety, 242, 109718.

Qian, Q., Qin, Y., Luo, J., Wang, Y., & Wu, F. (2023). Deep discriminative transfer learning network for crossmachine fault diagnosis. Mechanical Systems and Signal Processing, 186, 109884.

Qian, Q., Wang, Y., Zhang, T., & Qin, Y. (2023). Maximum mean square discrepancy: A new discrepancy representation metric for mechanical fault transfer diagnosis. Knowledge-Based Systems, 276, 110748.

Ram´ırez-Sanz, J. M., Maestro-Prieto, J.-A., ArnaizGonz´alez, ´A., & Bustillo, A. (2023). Semi-supervised learning for industrial fault detection and diagnosis: A systemic review. ISA transactions.

Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., . . . M¨uller, K.-R. (2021).

A unifying review of deep and shallow anomaly detection. Proceedings of the IEEE, 109(5), 756–795.

Wang, D., Shelhamer, E., Liu, S., Olshausen, B., & Darrell, T. (2021). Tent: Fully test-time adaptation by entropy minimization. In International conference on learning representations. Retrieved from https://openreview.net/forum?id=uXl3bZLkr3c

Wang, J., Qiu, K., Liu, W., Yu, T., & Zhao, L. (2018).

Unsupervised-multiscale-sequential-partitioning and multiple-svdd-model-based process-monitoring method for multiphase batch processes. Industrial & Engineering Chemistry Research, 57(51), 17437–17451.

Wang, Q., Fink, O., Van Gool, L., & Dai, D. (2022). Continual test-time domain adaptation. In Proceedings of the ieee/cvf conference on computer vision and pattern recognition (pp. 7201–7211).

Wang, Q., Michau, G., & Fink, O. (2019). Domain adaptive transfer learning for fault diagnosis. In 2019 prognostics and system health management conference (phmparis) (pp. 279–285).

Yan, P., Abdulkadir, A., Luley, P.-P., Rosenthal, M., Schatte, G. A., Grewe, B. F., & Stadelmann, T. (2024). A comprehensive survey of deep transfer learning for anomaly detection in industrial time series: Methods, applications, and directions. IEEE Access. Zhai, S., Cheng, Y., Lu, W., & Zhang, Z. (2016). Deep structured energy based models for anomaly detection. In International conference on machine learning (pp. 1100–1109). Zhang, J., Zou, J., Su, Z., Tang, J., Kang, Y., Xu, H.,

. . . Fan, S. (2022). A class-aware supervised contrastive learning framework for imbalanced fault diagnosis. Knowledge-Based Systems, 252, 109437.

Zhang, Z., & Deng, X. (2021). Anomaly detection using improved deep svdd model with data structure preservation. Pattern Recognition Letters, 148, 1–6.
Section
Technical Papers