From state observer to deep neural network: design, optimization, and application in bearing dynamics modeling

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Jan 13, 2026
Yiliang Qian Yan Wang Diwang Ruan Zhaorong Li Jianping Yan Clemens Gühmann

Abstract

Neural networks have been widely applied in system dynamics modeling. However, traditional neural networks still encounter limitations in capturing long-term dynamics, nonlinear modeling, and interpretability. To address these challenges, this study proposes a novel neural network architecture, Deep Stacked State-observer based Neural Network (DSSO-NN). Firstly, the state-space representation is introduced, integrating discretized state-space equations into the neural network design to leverage both system state information and deep learning capabilities. Subsequently, two optimization measures are employed to enhance the network's nonlinear modeling ability with activation functions and the state observer, respectively. Finally, DSSO-NN is validated using the Case Western Reserve University bearing dataset. Experimental results demonstrate that activation functions provide minimal improvement to model performance. In contrast, the incorporation of the state observer significantly enhances the DSSO-NN's ability to capture system dynamics behaviors and improves modeling accuracy. DSSO-NN exhibits higher precision and greater stability, offering a novel perspective on using the state observer as an alternative to traditional activation functions.

Abstract 41 | PDF Downloads 27

##plugins.themes.bootstrap3.article.details##

Keywords

State observer, Activation function, Bearing dynamics modeling, State-space network

References
Amoura, K., Wira, P., & Djennoune, S. (2011, 01). A state-space neural network for modeling dynamical nonlinear systems. NCTA 2011 - Proceedings of the International Conference on Neural Computation Theory and Applications, 369-376.
Apicella, A., Donnarumma, F., Isgrò, F., & Prevete, R. (2021). A survey on modern trainable activation functions. Neural Networks, 138, 14–32.
Deng, Q., Wang, C., & Lin, H. (2024). Memristive hopfield neural network dynamics with heterogeneous activation functions and its application. Chaos, Solitons & Fractals, 178, 114387.
Draper, N., & Smith, H. (1966). Applied regression analysis. Wiley.
Hauser, M., Gunn, S., Saab Jr., S., & Ray, A. (2019). State-space representations of deep neural networks. Neural Computation, 31(3), 538-554.
He, K., Zhang, X., Ren, S., & Sun, J. (2015). Deep Residual Learning for Image Recognition.
Li, H., Zhang, Z., Li, T., & Si, X. (2024). A review on physics-informed data-driven remaining useful life prediction: Challenges and opportunities. Mechanical Systems and Signal Processing, 209, 111120.
Londoño, J. D., & Olivera, C. (2019). Discretization by euler’s method for regular lagrangian flow.
Luenberger, D. (1967). Canonical forms for linear multivariable systems. IEEE Transactions on Automatic Control, 12(3), 290-293.
Luenberger, D. (1971). An introduction to observers. IEEE Transactions on Automatic Control, 16(6), 596-602.
Ramachandran, P., Zoph, B., & Le, Q. V. (2017). Searching for activation functions.
Rangapuram, S. S., Seeger, M. W., Gasthaus, J., Stella, L., Wang, Y., & Januschowski, T. (2018). Deep state space models for time series forecasting. In Advances in neural information processing systems (Vol. 31). Curran Associates, Inc.
Ren, H., Liu, R., Cheng, Z., Ma, H., & Li, H. (2023). Data-driven event-triggered control for nonlinear multi-agent systems with uniform quantization. IEEE Transactions on Circuits and Systems II: Express Briefs.
Ruan, D., Chen, Y., Gühmann, C., Yan, J., & Li, Z. (2022). Dynamics modeling of bearing with defect in modelica and application in direct transfer learning from simulation to test bench for bearing fault diagnosis. Electronics, 11(4), 622.
Ruan, D., Wang, J., Yan, J., & Gühmann, C. (2023). Cnn parameter design based on fault signal analysis and its application in bearing fault diagnosis. Advanced Engineering Informatics, 55, 101877.
Sarker, I. H. (2022). Ai-based modeling: techniques, applications and research issues towards automation, intelligent and smart systems. SN Computer Science, 3(2), 158.
Smith, W., & Randall, R. (2015, 05). Rolling element bearing diagnostics using the case western reserve university data: A benchmark study. Mechanical Systems and Signal Processing, 64-65.
Willmott, C., & Matsuura, K. (2005). Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Climate Research, 30, 79–82.
Section
Regular Session Papers