Multimodal sensor-to-machined surface image diffusion for defect detection in industrial processes

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Nov 11, 2024
Jae Gyeong Choi Yun Seok Kang Hyung Wook Park Sunghoon Lim

Abstract

Generative models, particularly diffusion-based approaches, have gained significant attention recently due to their ability to create realistic outputs. Despite their potential, the application of these models in manufacturing remains largely unexplored. This work presents a framework that addresses this gap by generating machined surface images guided by multiple sensor inputs in manufacturing. The proposed model integrates information from multiple sensors with varying sampling rates using multimodal embedding and employs a latent diffusion model to translate the fused sensor embedding into an image embedding, which is then converted into a machined surface image. The effectiveness of the framework is validated using real-world time-series data, including force, torque, acceleration, and sound, collected from various industrial processes, such as a carbon-fiber-reinforced plastic drilling process. The results demonstrate the model’s ability to predict defects from the generated machined surface images. The proposed approach can potentially revolutionize prognostics and health management (PHM) in smart manufacturing by enabling sensor-guided visual inspection, defect detection, process monitoring, and predictive maintenance.

How to Cite

Choi, J. G., Kang, Y. S., Park, H. W., & Lim, S. (2024). Multimodal sensor-to-machined surface image diffusion for defect detection in industrial processes. Annual Conference of the PHM Society, 16(1). https://doi.org/10.36001/phmconf.2024.v16i1.4212
Abstract 51 | PDF Downloads 28

##plugins.themes.bootstrap3.article.details##

Keywords

Diffusion, Drilling process, Image generation

References
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations.
Choi, J. G., Kim, D., Chung, M., Park, H. W., & Lim, S. (2023). Sensor to machined surface image generation in cfrp drilling. In Iise annual conference and expo.
Choi, J. G., Kim, D. C., Chung, M., Lim, S., & Park, H. W. (2024). Multimodal 1d cnn for delamination prediction in cfrp drilling process with industrial robots. Computers & Industrial Engineering, 190, 110074.
Lei, Y., Li, N., Guo, L., Li, N., Yan, T., & Lin, J. (2018). Machinery health prognostics: A systematic review from data acquisition to rul prediction. Mechanical Systems and Signal Processing, 104, 799-834.
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents.
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022). High-resolution image synthesis with latent diffusion models.
Song, J., Meng, C., & Ermon, S. (2022). Denoising diffusion implicit models.
Section
Doctoral Symposium Summaries