Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

IR and SAR Sensor Fusion based Target Detection using BMVT-M

BMVT-M을 이용한 IR 및 SAR 융합기반 지상표적 탐지

  • Lim, Yunji (Dept. of Electronic Engineering, Yeungnam University) ;
  • Kim, Taehun (Dept. of Electronic Engineering, Yeungnam University) ;
  • Kim, Sungho (Dept. of Electronic Engineering, Yeungnam University) ;
  • Song, WooJin (Dept. of Electrical Engineering, Pohang University of Science and Technology (POSETECH)) ;
  • Kim, Kyung-Tae (Dept. of Electrical Engineering, Pohang University of Science and Technology (POSETECH)) ;
  • Kim, Sohyeon (Agency for Defense Development)
  • 임윤지 (영남대학교 전자공학과) ;
  • 김태훈 (영남대학교 전자공학과) ;
  • 김성호 (영남대학교 전자공학과) ;
  • 송우진 (포항공과대학교 전자전기공학과) ;
  • 김경태 (포항공과대학교 전자전기공학과) ;
  • 김소현 (국방과학연구소)
  • Received : 2015.08.17
  • Accepted : 2015.10.22
  • Published : 2015.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

Infrared (IR) target detection is one of the key technologies in Automatic Target Detection/Recognition (ATD/R) for military applications. However, IR sensors have limitations due to the weather sensitivity and atmospheric effects. In recent years, sensor information fusion study is an active research topic to overcome these limitations. SAR sensor is adopted to sensor fusion, because SAR is robust to various weather conditions. In this paper, a Boolean Map Visual Theory-Morphology (BMVT-M) method is proposed to detect targets in SAR and IR images. Moreover, we suggest the IR and SAR image registration and decision level fusion algorithm. The experimental results using OKTAL-SE synthetic images validate the feasibility of sensor fusion-based target detection.

Keywords

References

  1. D. Nair and J. K. Aggarwal, "Robust automatic target recognition in second generation FLIR images," Proc. of the 3rd IEEE Workshop on Applications of Computer Vision, pp. 194-201, Dec. 1996.
  2. B. Kahler and E. Blasch, "Predicted radar/optical feature fusion gains for target identification," Proc. of the IEEE 2010 National Aerospace and Electronics Conference, pp. 405-412, Jul. 2010.
  3. S. I. Lee, J. Y. Kim, K. H, and B. H. Koo, "Small target detection method under complex FLIR imagery," Journal of Korea Multimedia Society, vol. 10, no. 4, pp. 432-440, Apr. 2007.
  4. B. Kahler and E. Blasch, "Predicted radar/optical feature fusion gains for target identification," Proc. of the IEEE 2010 National Aerospace and Electronics Conference, pp. 405-412, Jul. 2010.
  5. P. Wang, J. W. Tian, and C. Q. Gao, "Infrared small target detection using directional highpass filters based on LS-SVM," Electronics letters, vol. 45, no. 3, pp. 156-158, Jan. 2009. https://doi.org/10.1049/el:20092206
  6. S. Kim, Y. Yang, J. Lee, and Y. Park, "Small target detection utilizing robust methods of the human visual system for IRST," Journal of Infrared, Millimeter, and Terahertz Waves, vol. 30, no. 9, pp. 994-1011, May 2009. https://doi.org/10.1007/s10762-009-9518-2
  7. S. D. Deshpande, H. E. Meng, R. Venkatewarlu, and P. Chan, "Max-mean and max-median filters for detection of small targets," SPIE's International Symposium on Optical Science, Engineering, and Instrumentation. International Society for Optics and Photonics, pp. 74-83, 1999.
  8. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform," IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, Jun. 2008.
  9. L. Yang, J. Yang, and Z. Zheng, "Detecting infrared small targets based on adaptive local energy thershold under sea-sky complex backgrounds," Journal of Infrared and Millimeter Waves-chinese Edition, vol. 25, no. 1, 2006.
  10. M. Zeng, J. Li, and Z. Peng, "The design of top-hat morphological filter and application to infrared target detection," Infrared Physics & Technology, vol. 48, no. 1, pp. 67-76, 2006. https://doi.org/10.1016/j.infrared.2005.04.006
  11. X. Bai and F. Zhou, "Analysis of new top-hat transformation and the application for infrared dim small target detection," Pattern Recognition, vol. 43, no. 6, pp. 2145-2156, 2010. https://doi.org/10.1016/j.patcog.2009.12.023
  12. U. Braga-Neto, M. Choudhary, and J. Goutsias, "Automatic target detection and tracking in forward-looking infrared image sequences using morphological connected operators," Journal of Electronic Imaging, vol. 13, no. 4, pp. 802-813, 2004. https://doi.org/10.1117/1.1789982
  13. S. G. Sun and H. Park, "Segmentation of forward-looking infrared image using fuzzy thresholding and edge detection," Optical Engineering, vol. 40, no. 11, pp. 2638-2645, 2001. https://doi.org/10.1117/1.1409563
  14. S. Greenberg, S. R. Rotman, H. Guterman, S. Zilberman, and A. Gens, "Region-of-interest-based algorithm for automatic target detection in infrared images," Optical Engineering, vol. 44, no. 7, 2005.
  15. S. Gi, D. Ming, J. Ma, X. Sun, and J. Tian, "Robust method for infrared small-target detection based on Boolean map visual theory," Applied Optics, vol. 53, no. 18, pp. 3929-3940, 2014. https://doi.org/10.1364/AO.53.003929
  16. Z. Cui, J. Yang, S. Jiang, and C. wei, "Target detection algorithm based on two layers human visual system," Algorithms, vol. 8, no. 3, pp. 541-551, 2015. https://doi.org/10.3390/a8030541
  17. X. dong, X. Huang, Y. Zheng, L. Shen, and S. Bai, "Infrared dim and small target detecting and tracking method inspired by human visual system," Infrared Physics & Technology, vol. 62, pp. 100-109, Jan. 2014. https://doi.org/10.1016/j.infrared.2013.11.007
  18. L. Huang and H. Pashler, "A boolean map theory of visual attention," Psychological Review, vol. 114, no. 3, pp. 599-631, Jul. 2007. https://doi.org/10.1037/0033-295X.114.3.599
  19. R. M. Haralick, "Digital step edges from zero crossing of second directional derivatives," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 6, no. 1, pp. 58-68, Jan. 1984.
  20. Gonzalez and R. Woods, Digital Image Processing Third Edition, Prentice-Hall, Upper Saddle River, New Jersey, 2008.
  21. M. Zeng, J. Li, and Z. Peng, "The design of top-hat morphological filter and application to infrared target detection," Infrared Physics & Technology, vol. 48, no. 1, pp. 67-76, Apr. 2006. https://doi.org/10.1016/j.infrared.2005.04.006
  22. J. Latger, T. Cathala, N. Dounchin, and A. Le Goff, "Simulation of active and passive infrared images using the SE-WORKBENCH," Defense and Security Symposium. International Society for Optics and Photonics, 2007.
  23. Y. G. Byun and T. B. Chae, "Image fusion of high resolution SAR and optical image using high frequency information," Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, vol. 30, no. 1, pp. 75-86, Feb. 2012. https://doi.org/10.7848/ksgpc.2012.30.1.075
  24. Y. K. Han, Y. G. Byun, R. B Chae, and Y. I. Kim, "Automatic registration between KOMPSAT-2 and TerraSAR-X images," Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, vol. 29, no. 6, pp. 667-675, Dec. 2011. https://doi.org/10.7848/ksgpc.2011.29.6.667
  25. T. Song, "Multi-target tracking filters and data association: a survey," Journal of Institute of Control, Robotics and Systems (in Korean), vol. 20, no. 3, pp. 313-322, 2014. https://doi.org/10.5302/J.ICROS.2014.14.9018
  26. Y. Kim and T. Song, "A study of image target tracking using its in an occluding environment," Journal of Institute of Control, Robotics and Systems (in Korean), vol. 19, no. 4, pp. 306-314, 2013. https://doi.org/10.5302/J.ICROS.2013.12.1830