State of Health Estimation of Batteries Using a Time-Informed Dynamic Sequence-Inverted Transformer
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
The rapid adoption of battery-powered vehicles and energy storage systems over the past decade has made battery health monitoring increasingly critical. Batteries play a central role in the efficiency and safety of these systems, yet they inevitably degrade over time due to repeated charge discharge cycles. This degradation leads to reduced energy efficiency and potential overheating, posing significant safety concerns. Accurate estimation of a battery’s State of Health (SoH) is therefore essential for ensuring operational reliability and safety. Several machine learning architectures, such as LSTMs, transformers, and encoder-based models, have been proposed to estimate SoH from discharge cycle data. However, these models struggle with the irregularities inherent in real world measurements: discharge readings are often recorded at non uniform intervals, and the lengths of discharge cycles vary significantly. To address this, most existing approaches extract features from the sequences rather than processing them in full, which introduces information loss and compromises accuracy. To overcome these challenges, we propose a novel architecture: Time Informed Dynamic Sequence Inverted Transformer (TIDSIT). TIDSIT incorporates continuous time embeddings to effectively represent irregularly sampled data and utilizes padded sequences with temporal attention mechanisms to manage variable-length inputs without discarding sequence information. Experimental results on the NASA battery degradation dataset demonstrate that TIDSIT significantly outperforms existing models, achieving over a 43% reduction in prediction error compared to the strongest baseline. The model attains an RMSE% = 0.58%, indicating highly accurate SoH estimation. Furthermore, the architecture exhibits strong cross-battery generalization and shows promise for broader health monitoring tasks involving irregular time series data.
##plugins.themes.bootstrap3.article.details##
Batteries, State of Health Estimation, Transformer, Time Series, Irregular Measurements
Cabrera-Castillo, E., Niedermeier, F., & Jossen, A. (2016). Calculation of the state of safety (sos) for lithium ion batteries. Journal of Power Sources, 324, 509–520.
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers) (pp. 4171–4186).
Gu, X., See, K. W., Li, P., Shan, K., Wang, Y., Zhao, L., . . . Zhang, N. (2023). A novel state-of-health estimation for the lithium-ion battery using a convolutional neural network and transformer model. Energy, 262, 125501.
Guirguis, J., Abdulmaksoud, A., Ismail, M., Kollmeyer, P. J., & Ahmed, R. (2024). Transformer-based deep learning strategies for lithium-ion batteries sox estimation using regular and inverted embedding. IEEE Access.
Guo, Z., Qiu, X., Hou, G., Liaw, B. Y., & Zhang, C. (2014). State of health estimation for lithium ion batteries based on charging curves. Journal of Power Sources, 249, 457–462.
Huang, Z., Shi, X., Zhang, C., Wang, Q., Cheung, K. C., Qin, H., . . . Li, H. (2022). Flowformer: A transformer architecture for optical flow. In European conference on computer vision (pp. 668–685).
Kim, B., & Lee, J.-G. (2024). Continuous-time linear positional embedding for irregular time series forecasting. arXiv preprint arXiv:2409.20092.
Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. arXiv preprint arXiv:2001.04451.
Li, K., & Chen, X. (2025). Machine learning-based lithium battery state of health prediction research. Applied Sciences, 15(2), 516.
Liu, D., Luo, Y., Liu, J., Peng, Y., Guo, L., & Pecht, M. (2014). Lithium-ion battery remaining useful life estimation based on fusion nonlinear degradation ar model and rpf algorithm. Neural Computing and Applications, 25, 557–572.
Liu, Y., Hu, T., Zhang, H., Wu, H., Wang, S., Ma, L., & Long, M. (2023). itransformer: Inverted transformers are effective for time series forecasting. arXiv preprint arXiv:2310.06625
Lu, L., Han, X., Li, J., Hua, J., & Ouyang, M. (2013). A review on the key issues for lithium-ion battery management in electric vehicles. Journal of power sources, 226, 272–288.
Luo, K., Zheng, H., & Shi, Z. (2023). A simple feature extraction method for estimating the whole life cycle state of health of lithium-ion batteries using transformer-based neural network. Journal of Power Sources, 576, 233139.
Richardson, R. R., Osborne, M. A., & Howey, D. A. (2017). Gaussian process regression for forecasting battery state of health. Journal of Power Sources, 357, 209–219.
Saha, B., & Goebel, K. (2007). Battery data set. NASA AMES prognostics data repository.
Saha, B., & Goebel, K. (2008). Uncertainty management for diagnostics and prognostics of batteries using bayesian techniques. In 2008 ieee aerospace conference (pp. 1–8).
Swarnkar, R., Ramachandran, H., Ali, S. H. M., & Jabbar, R. (2023). A systematic literature review of state of health and state of charge estimation methods for batteries used in electric vehicle applications. World Electric Vehicle Journal, 14(9), 247.
Van, C. N., & Quang, D. T. (2023). Estimation of soh and internal resistances of lithium ion battery based on lstm network. International Journal of Electrochemical Science, 18(6), 100166.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., . . . Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
Venugopal, P. (2019). State-of-health estimation of li-ion batteries in electric vehicle using indrnn under variable load condition. Energies, 12(22), 4338.
Xu, Z., Guo, Y., & Saleh, J. H. (2022). A physics-informed dynamic deep autoencoder for accurate state-of-health prediction of lithium-ion battery. Neural Computing and Applications, 34(18), 15997–16017.
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021). Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the aaai conference on artificial intelligence (Vol. 35, pp. 11106–11115).