Development of Bearing Fault Diagnosis Model Using Low Frequency Data Based on Knowledge Distillation
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
Bearings are critical components for ensuring smooth rotational motion in mechanical systems, and reliable operation requires continuous condition monitoring for fault diagnosis. Recently, there has been growing interest in diagnosing bearing conditions using artificial intelligence, particularly deep learning-based approaches. However, in real industrial environments, limitations such as high sensor cost and restricted data storage often lead to the use of low sampling frequency sensor data, which poses challenges in developing accurate diagnosis models. To address this issue, this paper proposes a bearing fault diagnosis method based on knowledge distillation to enhance the utility of low sampling frequency data. High-frequency acceleration data were collected under both normal and faulty conditions and subsequently downsampled for knowledge distillation. A 1D CNN-based teacher model was trained using high-frequency data, and multiple loss functions were designed to distill both final predictions and intermediate features into a student model trained on low sampling frequency data. The performance comparison between models with and without knowledge distillation verified the effectiveness of the proposed approach. The results demonstrate the feasibility of developing fault diagnosis models using low sampling frequency data in real industrial settings and suggest an effective knowledge distillation strategy.
##plugins.themes.bootstrap3.article.details##
Knowledge Distillation, Bearing Fault Diagnosis, Low Sampling Frequency Data, 1D Convolutional Neural Network
Zhang, S., Zhang, S., Wang, B., & Habetler, T. G. (2019). Machine learning and deep learning algorithms for bearing fault diagnostics—A comprehensive review. arXiv 2019. arXiv preprint arXiv:1901.08247.
Siddique, M. F., Saleem, F., Umar, M., Kim, C. H., & Kim, J. M. (2025). A hybrid deep learning approach for bearing fault diagnosis using continuous wavelet transform and attention-enhanced spatiotemporal feature extraction. Sensors, vol. 25(9), pp. 2712.
Cui, Y., Zhang, Z., Zhong, Z., Hou, J., Chen, Z., Cai, Z., & Kim, J. H. (2025). Bearing Fault Diagnosis Based on Multiscale Lightweight Convolutional Neural Network. Processes, vol. 13(4), pp. 1239.
Hinton, G., Vinyals, O., & Dean, J. (2015). Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531.
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2015). FitNets: Hints for Thin Deep Nets. arXiv preprint arXiv: 1412.6550.

This work is licensed under a Creative Commons Attribution 3.0 Unported License.