Smart Structures and Systems

Techno-Press (테크노프레스)
권호 표지
DOI QR코드

DOI QR Code

Anomaly detection of isolating switch based on single shot multibox detector and improved frame differencing

  • Duan, Yuanfeng (College of Civil Engineering and Architecture, Zhejiang University) ;
  • Zhu, Qi (College of Civil Engineering and Architecture, Zhejiang University) ;
  • Zhang, Hongmei (College of Civil Engineering and Architecture, Zhejiang University) ;
  • Wei, Wei (College of Civil Engineering and Architecture, Zhejiang University) ;
  • Yun, Chung Bang (College of Civil Engineering and Architecture, Zhejiang University)
  • Received : 2021.04.22
  • Accepted : 2021.08.16
  • Published : 2021.12.25
⟨ Previous Next ⟩

Abstract

High-voltage isolating switches play a paramount role in ensuring the safety of power supply systems. However, their exposure to outdoor environmental conditions may cause serious physical defects, which may result in great risk to power supply systems and society. Image processing-based methods have been used for anomaly detection. However, their accuracy is affected by numerous uncertainties due to manually extracted features, which makes the anomaly detection of isolating switches still challenging. In this paper, a vision-based anomaly detection method for isolating switches, which uses the rotational angle of the switch system for more accurate and direct anomaly detection with the help of deep learning (DL) and image processing methods (Single Shot Multibox Detector (SSD), improved frame differencing method, and Hough transform), is proposed. The SSD is a deep learning method for object classification and localization. In addition, an improved frame differencing method is introduced for better feature extraction and a hough transform method is adopted for rotational angle calculation. A number of experiments are conducted for anomaly detection of single and multiple switches using video frames. The results of the experiments demonstrate that the SSD outperforms the You-Only-Look-Once network. The effectiveness and robustness of the proposed method have been proven under various conditions, such as different illumination and camera locations using 96 videos from the experiments.

Keywords

Acknowledgement

The research described in this paper was financially supported by the National Key R&D Program of China (2018YFE0125400, 2019YFE0112600, 2017YFC0806100) and National Natural Science Foundation of China (U1709216).

References

  1. Bouvy, R.J., Vincent, J., Parulski, K.A., Balch, K.S. and Erickson, G.L. (1995), "Progressive scan 30-frame-per-second megapixel camera", Proceedings of SPIE - The International Society for Optical Engineering, 2416, 30-36.
  2. Chen, A.W., Le, Q.M., Zhang, Z.Y. and Sun, Y. (2012), "Image recognition method for substation disconnecting switches state based on robots", Automat. Electric Power Syst., 6, 106-110.
  3. Choi, J.W., Wangbo, T.K. and Kim, C.G. (2015), "A contour tracking method of large motion object using optical flow and active contour model", Multimedia Tools Applicat., 74(1), 199-210. https://doi.org/10.1007/s11042-013-1756-6
  4. Duda, R.O. and Peter, E.H. (1972), "Use of the Hough transformation to detect lines and curves in pictures", Commun. ACM, 15(1), 11-15. https://doi.org/10.1145/361237.361242
  5. Everingham, M., Eslami, S.M.A., Van Gool, L., Williams, C.K.I., Winn, J. and Zisserman, A. (2015), "The pascal visual object classes challenge: a retrospective", Int. J. Comput. Vis., 111(1), 98-136. https://doi.org/10.1007/s11263-014-0733-5
  6. Fang, S., Shu, X.H. and Li, D.W. (2017), "A Method based on machine vision for opening-closing status recognition of substation disconnecting switches", J. Hunan Univ. Technol., 06, 1673-9833.
  7. Fei, M.J., Li, J. and Liu, H.H. (2015), "Visual tracking based on improved foreground detection and perceptual hashing", Neurocomputing, 152, 413-428. https://doi.org/10.1016/j.neucom.2014.09.060
  8. Felzenszwalb, P., Girshick, R., McAllester, D. and Ramanan, D. (2010), "Object detection with discriminatively trained part based models", IEEE Transact. Pattern Anal. Mach. Intell., 32(9), 1627-1645. https://doi.org/10.1109/TPAMI.2009.167
  9. Geiger, A., Lenz, P., Stiller, C. and Urtasun, R. (2013), "Vision meets robotics: The kitti dataset", Int. J. Robot. Res., 32(11), 1231-1237. https://doi.org/10.1177/0278364913491297
  10. Girshick, R. (2015), Fast R-CNN, Computer Science.
  11. Goodfellow, I., Bengio, Y. and Courville, A. (2016), Deep Learning, The MIT Press.
  12. Guo, Y., Xu, Y. and Li, S. (2020), "Vision-based full-field panorama generation by UAV using GPS data and feature points filtering", Smart Struct. Syst., Int. J., 25(5), 631-641. https://doi.org/10.12989/sss.2020.25.5.631
  13. Hough, V.P.C. (1962), Method and means for recognizing complex patterns.
  14. Jun, K.S., Jae-Yeal, N. and Chul, K.B. (2018), "Online tracker optimization for multi-pedestrian tracking using a moving vehicle camera", IEEE Access, 6, 48675-48687. https://doi.org/10.1109/ACCESS.2018.2867621
  15. Lei, X.S. and Sui, Z.H. (2019), "Intelligent fault detection of high voltage line based on the Faster R-CNN", Measurement, 138, 379-385. https://doi.org/10.1016/j.measurement.2019.01.072
  16. Li, M.H., Liu, Z.X., Xiong, Y.Y. and Li, Z. (2017), "Multi-person tracking by discriminative affinity model and hierarchical association", Proceedings of the 3rd IEEE International Conference on Computer and Communications (ICCC), Sichuan, China, December.
  17. Li, W.B., Chang, M.C. and Lyu, S. (2018), "Who did what at where and when: Simultaneous multi-person tracking and activity recognition", University at Albany, New York, NY, USA.
  18. Li, S., Guo, Y., Xu, Y. and Li, Z. (2019), "Real-time geometry identification of moving ships by computer vision techniques in bridge area", Smart Struct. Syst., Int. J., 23(4), 359-371. https://doi.org/10.12989/sss.2019.23.4.359
  19. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016), "SSD:Single shot multibox detector", Proceedings of European Conference on Computer Vision, Amsterdam, Netherlands, October.
  20. Liu, Y.Q., Zhan, F.Y., Jiang, X.W. and Zhou, H.Y. (2017), MATLAB: computer vision and deep learning combat.
  21. Mittal, S. (2013), "Object tracking using adaptive frame differencing and dynamic template matching method", Bachelor. Dissertation; National Institute of Technology Rourkela, Odisha, India.
  22. Mondal, T.G. and Jahanshahi, M.R. (2020), "Autonomous vision-based damage chronology for spatiotemporal condition assessment of civil infrastructure using unmanned aerial vehicle", Smart Struct. Syst., Int. J., 25(6), 733-749. https://doi.org/10.12989/sss.2020.25.6.733
  23. Nassu, B.T., Lippmann, L., Marchesi, B., Canestraro, A. and Zarnicinski, V. (2018), "Image-based state recognition for disconnect switches in electric power distribution substations", Proceedings of the 31st Conference on Graphics, Patterns and Images (SIBGRAPI), Foz do Iguacu, Brazil, October.
  24. Otsu, N. (1979), "A thresholding selection method from gray-level histogram", IEEE Trans.syst.man. & Cybern, 9(1), 62-66. https://doi.org/10.1109/TSMC.1979.4310076
  25. Paul, N., Singh, A., Midya, A., Roy, P.P. and Dogra, D.P. (2017), "Moving object detection using modified temporal differencing and local fuzzy thresholding", J. Supercomput., 73, 1120-1139. https://doi.org/10.1007/s11227-016-1815-7
  26. Rahman, M.A. and Wang, Y. (2016), "Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation", Proceedings of the 12th International Symposium on Visual Computing (ISVC), Las Vegas, VA, USA, December.
  27. Ran, N., Kong, L., Wang, Y.H. and Liu, Q.J. (2019), "A robust multi-athlete tracking algorithm by exploiting discriminant features and long-term dependencies", Proceedings of the 25th International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece, January.
  28. Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016), "You only look once: Unified, real-time object detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, June.
  29. Ren, S., He, K., Girshick, R. and Sun, J. (2015), "Faster R-CNN:Towards real-time object detection with region proposal networks", Proceedings of the 29th Annual Conference on Neural Information Processing Systems (NIPS), Montreal, Canada, December.
  30. Serra, J. (1982), "Image analysis and mathematical morphology", Biometrics, 39(2), 536.
  31. Shafiee, M.J., Chywl, B., Li, F. and Wong, A. (2017), "Fast YOLO: A fast you only look once system for real-time embedded object detection in video", J. Computat. Vision Imag. Syst., 3(1).
  32. Sharma, S., Ansari, J.A., Murthy, J.K. and Krishna, K.M. (2017), "Beyond pixels: Leveraging geometry and shape cues for online multi-object tracking", Proceedings of 2018 IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, June.
  33. Shi, Y.H., Luo, Y., Tu, G.Y. and Wu, T. (2007), "An edge detectable algorithm for high-voltage isolating switch", Relay, 35(12), 23-26. https://doi.org/10.3969/j.issn.1674-3415.2007.12.006
  34. Siddiqui, Z.A., Park, U., Lee, S.-W., Jung, N.-J., Choi, M., Lim, C. and Seo, J.-H. (2018), "Robust powerline equipment inspection system based on a convolutional neural network", Sensors, 18(11), 3837. https://doi.org/10.3390/s18113837
  35. Simonyan, K. and Zisserman, A. (2014), "Very Deep Convolutional Networks for Large-Scale Image Recognition", Proceedings of 2015 International Conference on Learning Representations (ICLR), San Diego, CA, USA, May.
  36. Supreeth, H.S.G. and Patil, C.M. (2018), "Efficient multiple moving object detection and tracking using combined background subtraction and clustering", Signal Image and Video Processing, 12(6), 1097-1105. https://doi.org/10.1007/s11760-018-1259-z
  37. Tang, S., Andriluka, M., Andres, B. and Schiele, B. (2017), "Multiple person tracking by lifted multicut and person re-identification", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, USA, June.
  38. Wang, H., Xu, F., Jin, Y.Q. and Ouchi, K. (2009), "Estimation of bridge height over water from polarimetric sar image data using mapping and projection algorithm and de-orientation theory", IEICE Transact. Commun., 92(12), 3875-3882. https://doi.org/10.1587/transcom.E92.B.3875
  39. Wang, J., Liu, Q., Zhao, K., Yi, J. and Kai, P. (2017), "Recognition of high voltage isolating switch's states based on object tracking", Proceedings of 4th International Conference on Systems and Informatics (ICSAI), Zhejiang, China, November.
  40. Wanyan, X.X., Fu, Q.C. and Xin, J. (2019), "Research on multi - target recognition of traction substation video based on transfer learning", Comput. Eng. Applicat., 55(24), 196-201.
  41. Ye, X.W., Dong, C.Z. and Liu, T. (2016), "Image-based structural dynamic displacement measurement using different multi-object tracking algorithms", Smart Struct. Syst., Int. J., 17(6), 935-956. https://doi.org/10.12989/sss.2016.17.6.935
  42. Yin, X., Chen, W., Wu, X. and Yue, H. (2018), "Fine-tuning and visualization of convolutional neural networks", Proceedings of 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), IEEE.
  43. YOLOv5 (2020), https://github.com/ultralytics/yolov5. Ultralytics LLC, CA, USA.
  44. Yu, C., Ding, X., Zhang, G. and Chen, M. (2017), "Observing Bridge Dynamic Deformation in Vibration by Digital Photography System", Proceedings of 2nd International Conference on Mechatronics and Information Technology.
  45. Zhao, R., Shang, W., Wang T. and Zou, X. (2016), "State Evaluation of Isolating Switch in Transformer Substation Based on Image Processing", Comput. Measure. Control, 24, 241.
  46. Zhao, D.W., Fu, H., Xiao, L., Wu, T. and Dai, B. (2018), "Multi-object tracking with correlation filter for autonomous vehicle", Sensors, 18(7), 2004. https://doi.org/10.3390/s18072004
  47. Zhu, D., Feng, Y., Chen, Q. and Cai, J. (2010), "Image recognition technology in rotating machinery fault diagnosis based on artificial immune", Smart Struct. Syst., Int. J., 6(4), 389-403. https://doi.org/10.12989/sss.2010.6.4.389
  48. Zoph, B., Cubuk, E.D., Ghiasi, G., Lin, T.Y., Shlens, J. and Le, Q.V. (2020), "Learning data augmentation strategies for object detection", Proceedings of European Conference on Computer Vision.