Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Real-Time Object Detection System Based on Background Modeling in Infrared Images

적외선영상에서 배경모델링 기반의 실시간 객체 탐지 시스템

  • 박장한 (삼성탈렉스(주) 종합연구소) ;
  • 이재익 (삼성탈렉스(주) 종합연구소)
  • Published : 2009.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an object detection method for real-time in infrared (IR) images and PowerPC (PPC) and H/W design based on field programmable gate array (FPGA). An open H/W architecture has the advantages, such as easy transplantation of HW and S/W, support of compatibility and scalability for specification of current and previous versions, common module design using standardized design, and convenience of management and maintenance. Proposed background modeling for an open H/W architecture design decreases size of search area to construct a sparse block template of search area in IR images. We also apply to compensate for motion compensation when image moves in previous and current frames of IR sensor. Separation method of background and objects apply to adaptive values through time analysis of pixel intensity. Method of clutter reduction to appear near separated objects applies to median filter. Methods of background modeling, object detection, median filter, labeling, merge in the design embedded system execute in PFC processor. Based on experimental results, proposed method showed real-time object detection through global motion compensation and background modeling in the proposed embedded system.

본 논문은 적외선영상(infrared image)에서 배경모델링 기반의 실시간 객체 탐지 기법과 고속 PPC(PowerPC) & FPGA(Field Programmable Gate Array) 기반 개방형 구조의 하드웨어 설계 방법을 제안한다. 개방형 구조는 하드웨어 및 소프트웨어의 이식이 용이하고, 확장, 호환성, 관리 및 유지보수 등이 편리한 장점이 있다. 제안된 배경모델링 방법을 개방형 구조에 탑재하기 위하여 입력영상에서 검색영역 템플릿을 성긴 블록으로 구성하여 탐색영역의 크기를 줄인다. 또한, 이전 프레임과 현재 프레임에서 영상의 흔들림이 발생했을 때 보정하기 위해 전역움직임 보상방법을 적용한다. 배경과 객체를 분리는 픽셀 밝기의 시간 분석을 통해 적응적 값을 적용한다. 분리된 객체주변에 발생하는 클러터 제거 방법은 중앙값 필터를 적용한다. 설계된 임베디드 시스템에서 배경모델링, 객체탐지, 중앙값 필터, 라벨링, 합병 등의 방법은 PPC에서 구현하였다. 실험결과 제안된 임베디드 시스템에서 전역 움직임 보정과 배경예측을 통해 실시간으로 객체가 탐지될 수 있음을 보였다.

Keywords

References

  1. A. Yilmaz, O. Javed, and M. Shah, 'Object tracking: a survey,' Association for Computing Machinery (ACM) Computing Surveys, Vol. 38, no. 4, pp. 1-45, December 2006 https://doi.org/10.1145/1177352.1177355
  2. W. Hu, T. Tan, L. Wang, and S. Maybank, 'A survey on visual surveillance of object motion and behaviors,' IEEE Trans. Systems, Man, & Cybernetics - Part C: Applications & Reviews, Vol. 34, no. 3, pp. 334-352, August 2004 https://doi.org/10.1109/TSMCC.2004.829274
  3. H. Lee, S. Kim, D. Park, J. Kim, and C. Park, 'Robust method for detecting an infrared small moving target based on the facet-based model,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Defense and Security Symposium (DSS 2008), Vol. 6969, no. 69690E, pp. 1-9, April 2008 https://doi.org/10.1117/12.777485
  4. J. Lee, Y. Youn, and C. Park, 'PowerPC-based system for tracking in infrared image sequences,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Europe Security Defence (ESD 2007), Vol. 6737, no. 67370S, pp. 1-9, October 2007 https://doi.org/10.1117/12.738511
  5. J. Jung, H. Lee, D. Park, C. Park, and J. Lee, 'Adaptive target segmentation using runtime-weighted features,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Defense and Security Symposium (DSS 2007), Vol. 6567, no. 65671F, pp. 1-7, May 2007 https://doi.org/10.1117/12.719293
  6. M. Sedaaghi, 'Morphological operators,' Electronics Letters, Vol. 38, no. 22, pp. 1333-1335, October 2002 https://doi.org/10.1049/el:20020943
  7. J. Wang, J. Chun, and Y. Park, 'Adaptive matched filtering for the varying attitude of a target,' Proc. The International Society for Optical Engineering (SPIE), High-Speed Imaging and Sequence Analysis II, Vol. 3968, no. 22, pp. 22-30, January 2000 https://doi.org/10.1117/12.378877
  8. W. Yang, Z. Shen, and Z. Li, 'The application of difference method to dim point target detection in infrared images,' Proc. IEEE, Vol. 1, pp. 133-36, May 1994 https://doi.org/10.1117/12.179099
  9. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, 'Detecting moving objects, ghosts, and shadows in video Streams,' IEEE Trans. Pattern Analysis, Machine Intelligence, Vol. 25, no. 10, pp. 1337-1342, October 2003 https://doi.org/10.1109/TPAMI.2003.1233909
  10. R. Tan, H. Huo, J. Qian, and T. Fang, 'Traffic video segmentation using adaptive-K gaussian mixture model,' Proc. Lecture Notes in Computer Science (LNCS), Advances in Machine Vision, Image Processing, and Pattern Analysis, Vol. 4153, pp. 125-134, August 2006 https://doi.org/10.1007/11821045_13
  11. C. Gonzalez and E. Woods, Digital Image Processing, 2nd Edition, Prentice Hall, 2002
  12. Y. Chen, Y. Hung, and C. Fuh, 'Fast block matching algorithm based on the winner-update strategy,' IEEE Trans. Image Processing, Vol. 10, no. 8, pp. 1212-1222, August 2001 https://doi.org/10.1109/83.935037