한국인공지능학회지 (Korean Journal of Artificial Intelligence)

한국인공지능학회 (Korea Artificial Intelligence Association)
권호 표지
DOI QR코드

DOI QR Code

Black Ice Detection Platform and Its Evaluation using Jetson Nano Devices based on Convolutional Neural Network (CNN)

  • Sun-Kyoung KANG (Department of Computer Engineering, Wonkwang University) ;
  • Yeonwoo LEE (Department of Information & Communication Engineering, Mokpo National University)
  • 투고 : 2023.11.06
  • 심사 : 2023.12.01
  • 발행 : 2023.12.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

In this paper, we propose a black ice detection platform framework using Convolutional Neural Networks (CNNs). To overcome black ice problem, we introduce a real-time based early warning platform using CNN-based architecture, and furthermore, in order to enhance the accuracy of black ice detection, we apply a multi-scale dilation convolution feature fusion (MsDC-FF) technique. Then, we establish a specialized experimental platform by using a comprehensive dataset of thermal road black ice images for a training and evaluation purpose. Experimental results of a real-time black ice detection platform show the better performance of our proposed network model compared to conventional image segmentation models. Our proposed platform have achieved real-time segmentation of road black ice areas by deploying a road black ice area segmentation network on the edge device Jetson Nano devices. This approach in parallel using multi-scale dilated convolutions with different dilation rates had faster segmentation speeds due to its smaller model parameters. The proposed MsCD-FF Net(2) model had the fastest segmentation speed at 5.53 frame per second (FPS). Thereby encouraging safe driving for motorists and providing decision support for road surface management in the road traffic monitoring department.

키워드

참고문헌

  1. Abdalla, Y. E., Iqbal, M. T., & Shehata, M. (2017, April). "Black Ice detection system using Kinect," In 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE) (pp. 1- 4). IEEE.
  2. Breckon, T., & Fisher, R. B. (2012). A novel thermal-based approach to black ice detection. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR) (pp. 1492-1495). IEEE.
  3. Chen, L. C., Papandreou, G., Schroff, F., & Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587.
  4. Huang, G., Chen, D., Li, T., Wu, F., Van Der Maaten, L., & Weinberger, K. Q. (2017). Multi-scale dense networks for resource efficient image classification. arXiv preprint arXiv:1703.09844.
  5. Kang, S. (2023). Multi-Scale Dilation Convolution Feature Fusion (MsDC-FF) Technique for CNN-Based Black Ice Detection. Korean Journal of Artificial Intelligence 11(3), 17-22. http://dx.doi.org/10.24225/kjai.2023.11.3.17
  6. Kim, S.-J., Yoon, W.-S., & Kim, Y.-K. (2021). Characteristics of Black Ice Using Thermal Imaging Camera. Journal of the Korean Society of Industry Convergence, 24(6_2), 873-882. https://doi.org/10.21289/KSIC.2021.24.6.873
  7. Korea Traffic Accident Analysis System [Internet]. Available: http://taas.koroad.or.kr/.
  8. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90. https://doi.org/10.1145/3065386
  9. Lee, H., Hwang, K., Kang, M., & Song, J. (2020, December). Black ice detection using CNN for the Prevention of Accidents in Automated Vehicle. In 2020 International Conference on Computational Science and Computational Intelligence (CSCI) (pp. 1189-1192). IEEE.
  10. Li, Q., Ji, Y. W., Wang, Z. P., & Dou, X. (2017). Design of Road Icing Detection System Based on Opencv+ Python. Journal of Shaanxi University of Science & Technology (Natural Science Edition), 35(2), 158-164.
  11. Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3431-3440).
  12. Ma, X., & Ruan, C. (2020). "Method for black ice detection on roads using tri-wavelength backscattering measurements," Applied Optics, 59(24), 7242-7246. https://doi.org/10.1364/AO.398772
  13. Park, G. Y., Lee, S. H., Kim, E. J., & Yun, B. Y. (2017). A case study on meteorological analysis of freezing rain and black ice formation on the load at winter. Journal of Environmental Science International, 26(7), 827-836.
  14. Paszke, A., Chaurasia, A., Kim, S., & Culurciello, E. (2016). Enet: A deep neural network architecture for real-time semantic segmentation. arXiv preprint arXiv:1606.02147.
  15. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18 (pp. 234-241). Springer International Publishing.
  16. Smith, S., Williams, B. L., & Prato, C. G. (2017). Black ice detection. In Encyclopedia of Traffic Science (pp. 1-7). Springer.
  17. Tabatabai, H., & Aljuboori, M. (2017). A novel concrete-based sensor for detection of ice and water on roads and bridges. Sensors," 17(12), 2912.
  18. Wang, Q., Zhang, X., Chen, C., & Li, P. (2019). Black ice detection method based on the temperature field characteristic of thermal images. Journal of Advanced Transportation, 1-14.
  19. Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2881-2890).