Integrating Few-Shot Learning and Pre-trained Models into Similarity-Based PHM using Small Data in Complex Engineering Systems

Abstract

Prognostics and Health Management (PHM) is vital for complex engineering systems, yet its data-driven solutions are often hampered by the "small data problem"—a scarcity of labeled fault data in industrial settings. This limitation restricts the training and generalization of machine learning models and is compounded by varying operational conditions that reduce the relevance of historical data and pre-trained models. This research introduces a research framework to tackle these small data challenges in PHM. The primary objective is to develop a robust and adaptable PHM methodology by enhancing and synergistically integrating similarity-based Few-Shot Learning (FSL) with large-scale pre-trained time-series models. The research will focus on two main thrusts. First, it aims to improve the generalization capabilities of FSL frameworks by addressing limitations such as noise robustness, domain shift adaptability, and generalization to novel faults across diverse PHM domains. This involves developing noise-robust feature extraction, integrating domain adaptation techniques, and exploring expressive similarity metrics. Second, the study will investigate the effective adaptation of state-of-the-art pre-trained time-series models (e.g., TimesNet) for PHM tasks under data scarcity, focusing on efficient fine-tuning and synergistic integration with the enhanced FSL approaches. The author's prior success in a PHM data challenge using a similarity-based method for spacecraft systems provides preliminary validation. This research is expected to deliver an enhanced PHM framework for high-accuracy diagnostics with limited data, contributing generalized FSL models, systematic methods for leveraging pre-trained models in PHM, and advancing the practical deployment of intelligent PHM solutions.