Journal of Digital Contents Society (디지털콘텐츠학회 논문지)

Digital Contents Society (한국디지털콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Object Detection based on Mask R-CNN from Infrared Camera

적외선 카메라 영상에서의 마스크 R-CNN기반 발열객체검출

  • Song, Hyun Chul (Center of Virtual Reality and Augmented Reality, Nam-Seoul University) ;
  • Knag, Min-Sik (Department of Industrial Management Engineering, Nam-Seoul University) ;
  • Kimg, Tae-Eun (Department of Multimedia, Nam-Seoul University)
  • 송현철 (남서울대학교 가상증강현실센터) ;
  • 강민식 (남서울대학교 산업경영공학과) ;
  • 김태은 (남서울대학교 멀티미디어학과)
  • Received : 2018.04.20
  • Accepted : 2018.05.25
  • Published : 2018.06.30
⟨ Previous Next ⟩

Abstract

Recently introduced Mask R - CNN presents a conceptually simple, flexible, general framework for instance segmentation of objects. In this paper, we propose an algorithm for efficiently searching objects of images, while creating a segmentation mask of heat generation part for an instance which is a heating element in a heat sensed image acquired from a thermal infrared camera. This method called a mask R - CNN is an algorithm that extends Faster R - CNN by adding a branch for predicting an object mask in parallel with an existing branch for recognition of a bounding box. The mask R - CNN is added to the high - speed R - CNN which training is easy and fast to execute. Also, it is easy to generalize the mask R - CNN to other tasks. In this research, we propose an infrared image detection algorithm based on R - CNN and detect heating elements which can not be distinguished by RGB images. As a result of the experiment, a heat-generating object which can not be discriminated from Mask R-CNN was detected normally.

최근 비전분야에 소개된 Mask R-CNN은 객체 인스턴스 세분화를위한 개념적으로 간단하고 유연하며 일반적인 프레임 워크를 제시한다. 이 논문에서는 열적외선 카메라로부터 획득한 열감지영상에서 발열체인 인스턴스에 대해 발열부위의 세그멘테이션 마스크를 생성하는 동시에 이미지 내의 오브젝트 발열부분을 효율적으로 탐색하는 알고리즘을 제안한다. Mask R-CNN 기법은 바운딩 박스 인식을 위해 기존 브랜치와 병렬로 객체 마스크를 예측하기 위한 브랜치를 추가함으로써 Faster R-CNN을 확장한 알고리즘이다. Mask R-CNN은 훈련이 간단하고 빠르게 실행하는 고속 R-CNN에 추가된다. 더욱이, Mask R-CNN은 다른 작업으로 일반화하기 용이하다. 본 연구에서는 이 R-CNN기반 적외선 영상 검출알고리즘을 제안하여 RGB영상에서 구별할 수 없는 발열체를 탐지하였다. 실험결과 Mask R-CNN에서 변별하지 못하는 발열객체를 성공적으로 검출하였다.

Keywords

Acknowledgement

Supported by : 농림식품기술기획평가원

References

  1. Y. B. Whang, Y. H. Joh, Artificial Intelligence Technology Trends for Speed Driving, KEIT PD Issue report, Vol. 16, No. 11, pp. 30-48, 2016.
  2. S. J. Lee, J. S. Lim, O. H. Kwon, Electronics and Telecommunications Trends, pp. 18-27, 2012.
  3. D. G. Kim, J. H. Choi, T. J. Kil, J. H. Kim, T. G. Kim, Experimental Study on Surface Temperature Variation Characteristics of Rectangular Parallelepipeds Constructed by Different Materials for Varying Meteorological Conditions, Korea Institute of Millitary Science and Technology, Vol. 15, No.2, pp. 208-214, 2012. https://doi.org/10.9766/KIMST.2012.15.2.208
  4. J.H. Choi, D.H. Kim, K.I. Han, N.K. Ha, H.S. Jang, S.H. Lee, D.G. Kim and T.K. Kim, Analysis of Ir Signal Characteristics of A Ship for Non-Uniform Atmospheric Conditions, Korean Society for Computational Fluids Engineering, Vol. 22, No.1, pp.88-94, 2017. https://doi.org/10.6112/kscfe.2017.22.1.088
  5. R. Girshick, "Fast R-CNN," in International Conference on Computer Vision (ICCV), 2015.
  6. S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks," in Neural Information Processing Systems (NIPS), 2015.
  7. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in CVPR, 2015.
  8. Girshick, Ross, et al. "Rich feature hierarchies for accurate object detection and semantic segmentation." Proceedings of the IEEE conference on computer vision and pattern recognition. 2014.
  9. Uijlings, Jasper RR, et al. "Selective search for object recognition." International journal of computer vision 104.2 (2013): 154-171. https://doi.org/10.1007/s11263-013-0620-5
  10. Drucker, Harris, Christopher JC Burges, Linda Kaufman, Alex J. Smola, and Vladimir Vapnik. "Support vector regression machines." In Advances in neural information processing systems, pp. 155-161. 1997.
  11. He, Kaiming, Georgia Gkioxari, Piotr Dollar, and Ross Girshick. "Mask r-cnn." In Computer Vision (ICCV), 2017 IEEE International Conference on, pp. 2980-2988. IEEE, 2017.
  12. He, Kaiming, Georgia Gkioxari, Piotr Dollar, and Ross Girshick. "Mask r-cnn." IEEE transactions on pattern analysis and machine intelligence (Early Access), 2018.

Cited by

  1. 영상 폐색영역 검출 및 해결을 위한 딥러닝 알고리즘 적용 가능성 연구 vol.20, pp.11, 2018, https://doi.org/10.5762/kais.2019.20.11.305