Journal of the Institute of Convergence Signal Processing (융합신호처리학회논문지)

The Korea Institute of Convergence Signal Processing (한국융합신호처리학회)
권호 표지

CNN-based Automatic Machine Fault Diagnosis Method Using Spectrogram Images

스펙트로그램 이미지를 이용한 CNN 기반 자동화 기계 고장 진단 기법

  • Kang, Kyung-Won (Dept. of Information Communication & Software Engineering, Tongmyong University) ;
  • Lee, Kyeong-Min (College of General Education, Tongmyong University)
  • 강경원 (동명대학교 정보통신소프트웨어공학과) ;
  • 이경민 (동명대학교 학부교양대학)
  • Received : 2020.06.05
  • Accepted : 2020.09.21
  • Published : 2020.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Sound-based machine fault diagnosis is the automatic detection of abnormal sound in the acoustic emission signals of the machines. Conventional methods of using mathematical models were difficult to diagnose machine failure due to the complexity of the industry machinery system and the existence of nonlinear factors such as noises. Therefore, we want to solve the problem of machine fault diagnosis as a deep learning-based image classification problem. In the paper, we propose a CNN-based automatic machine fault diagnosis method using Spectrogram images. The proposed method uses STFT to effectively extract feature vectors from frequencies generated by machine defects, and the feature vectors detected by STFT were converted into spectrogram images and classified by CNN by machine status. The results show that the proposed method can be effectively used not only to detect defects but also to various automatic diagnosis system based on sound.

소리 기반 기계 고장 진단은 기계의 음향 방출 신호에서 비정상적인 소리를 자동으로 감지하는 것이다. 수학적 모델을 사용하는 기존의 방법은 기계 시스템의 복잡성과 잡음과 같은 비선형 요인이 존재하기 때문에 기계 고장 진단이 어려웠다. 따라서 기계 고장 진단의 문제를 딥러닝 기반 이미지 분류 문제로 해결하고자 한다. 본 논문에서 스펙트로그램 이미지를 이용한 CNN 기반 자동화 기계 고장 진단 기법을 제안한다. 제안한 방법은 기계의 결함 시 발생하는 주파수상의 특징 벡터를 효과적으로 추출하기 위해 STFT를 사용하였으며, STFT에 의해 검출된 특징 벡터들은 스펙트로그램 이미지로 변환하여 CNN을 이용해 기계의 상태별로 분류한다. 그 결과는 제안한 방법은 효과적으로 결함을 탐지할 뿐만 아니라 소리 기반의 다양한 자동 진단 시스템에도 효과적으로 활용될 수 있다.

Keywords

References

  1. J. Wan, S. Tang, D. Li, S. Wang, C. Liu, H. Abbas, A. V. Vasilakos, "A manufacturing big data solution for active preventive maintenance," IEEE Transactions on Industrial Electronics, vol. 13, no. 4, pp. 2039-2047, 2017. https://doi.org/10.1109/TII.2017.2670505
  2. Y. Lei, F. Jia, J. Lin, S. Xing, S. X. Ding, "An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data," IEEE Transactions on Industrial Electronics, vol. 63, no. 5, pp. 3137-3147, 2016. https://doi.org/10.1109/TIE.2016.2519325
  3. J. Jiao, M. Zhao, J. Lin, K. Liang, "Hierarchical discriminating sparse coding for weak fault feature extraction of rolling bearings," Reliability Engineering & System Safety, vol. 184, pp. 41-54, 2019. https://doi.org/10.1016/j.ress.2018.02.010
  4. M. Zhao, X. Jia, "A novel strategy for signal denoising using reweighted SVD and its applications to weak fault feature enhancement of rotating machinery," Mechanical Systems and Signal Processing, vol. 94, pp. 129-147, 2017. https://doi.org/10.1016/j.ymssp.2017.02.036
  5. B. Robert, J. Antoni, "Rolling element bearing diagnostics," Mechanical System and Signal Processing, vol. 25, no. 2, pp. 485-520, 2011. https://doi.org/10.1016/j.ymssp.2010.07.017
  6. T. H. loutas, G. Sotiriades, I. kalaitzoglou, V. Kostopouls, "Condition monitoring of a single stage gearbox with artificially induced gear cracks utilizing on-line vibration and acoustic emission measurements," Applied Acoustics, vol. 70, issue 9, pp. 1148-1159, 2009. https://doi.org/10.1016/j.apacoust.2009.04.007
  7. C. Chen, B. Zhang, G. Vachtsevanos, M. Orchard, "Machine condition prediction based on adaptive neuro-fuzzy and high-order particle filtering," IEEE Trans. Industrial Electronics, vol. 58, issue 9, pp. 4353-4364, 2011. https://doi.org/10.1109/TIE.2010.2098369
  8. Y. S. Wang, Q. H. Ma, Q. Zhu, L. Zhao, "An intelligent approach for engine fault diagnosis based on hibert-huang transform and support vector machine," Applied Acoustics, vol. 75, pp. 1-9, 2014. https://doi.org/10.1016/j.apacoust.2013.07.001
  9. M. Gan, C. Wang, C. A. Zhu, "Construction of hierarchical diagnosis network based on deep learning and its application in te fault pattern recognition of rolling element bearings," Mechanical Systems and Signal Processing, vol. 72-73, no. 11, pp. 7067-7075.
  10. W. Sun, R. Zhao, R. Yan, S. Shao, X. Chen, "Convolutional discriminative feature learning for induction motor fault diagnosis," IEEE Transactions on Industrial Informatics, vol. 13, no. 3, pp. 1350-1359, 2017. https://doi.org/10.1109/TII.2017.2672988
  11. B. Sreejith, A. K. Verma, A. Srividya, "Fault diagnosis of rolling element bearing using time-domain features and neural networks," IEEE Region 10 and the Third International Conference on Industrial and Information Systems, pp. 1-6, 2009.
  12. T. Ince, S. Kiranyaz, L. Eren, M. Askar, M. Gabbouj, "Real-time motor fault detection by 1D convolutional neural networks," IEEE Transactions on Industrial Electronics, vol. 63, no. 11, pp. 7067-7075, 2016. https://doi.org/10.1109/TIE.2016.2582729
  13. P. K. Kankar, S. C. Sharma, S. P. harsha, "Fault diagnosis of ball bearings using machine learning methods," Expert Systems with Applications, vol. 38, issue 3, pp. 1876-1886, 2011. https://doi.org/10.1016/j.eswa.2010.07.119
  14. D. Z. Li, W. Wang, F. Ismailm, "An enhanced bispectrum technique with auxiliary frequency injection for induction motor health condition monitoring," IEEE Transactions on Instrumentation & Measurement, vol. 64, no. 10, pp. 2679-2687, 2015. https://doi.org/10.1109/TIM.2015.2419031
  15. J. D. Zheng, H. Y. Pan, X. L Qi, X. Q. Zhang, Q. Y. Liu, "Enhanced empirical wavelet transform based time-frequency analysis and its application to rolling bearing fault diagnosis," Acta Electronica Sinica, vol. 46, no. 2, pp. 358-364, 2018.
  16. K. M. Lee, C. Vununu, K. S. Moon, S. H. Lee, K. R. Kwon, "Automatic machine fault diagnosis system using discrete wavelet transform and machine learning," Journal of Korea Multimedia Society, vol. 20, no. 8, pp. 1299-1311, 2017. https://doi.org/10.9717/kmms.2017.20.8.1299