KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Local and Global Information Exchange for Enhancing Object Detection and Tracking

  • Lee, Jin-Seok (Dept. of Biomedical Engineering, Worcester Polytechnic Institute) ;
  • Cho, Shung-Han (Mobile Systems Design Laboratory, Dept. of Electrical and Computer Engineering, Stony Brook University-SUNY) ;
  • Oh, Seong-Jun (College of Information and Communications, Korea University) ;
  • Hong, Sang-Jin (Mobile Systems Design Laboratory, Dept. of Electrical and Computer Engineering, Stony Brook University-SUNY)
  • Received : 2011.10.30
  • Accepted : 2012.02.13
  • Published : 2012.05.30
Download PDF
⟨ Previous Next ⟩

Abstract

Object detection and tracking using visual sensors is a critical component of surveillance systems, which presents many challenges. This paper addresses the enhancement of object detection and tracking via the combination of multiple visual sensors. The enhancement method we introduce compensates for missed object detection based on the partial detection of objects by multiple visual sensors. When one detects an object or more visual sensors, the detected object's local positions transformed into a global object position. Local and global information exchange allows a missed local object's position to recover. However, the exchange of the information may degrade the detection and tracking performance by incorrectly recovering the local object position, which propagated by false object detection. Furthermore, local object positions corresponding to an identical object can transformed into nonequivalent global object positions because of detection uncertainty such as shadows or other artifacts. We improved the performance by preventing the propagation of false object detection. In addition, we present an evaluation method for the final global object position. The proposed method analyzed and evaluated using case studies.

Keywords

References

  1. R. Feraud, O.J. Bernier, J.-E. Viallet and M. Collobert, "A fast and accurate face detection based on neural network," IEEE Trans. on Signal Processing, vol.50, no.2, pp.174-188, Feb.2002. https://doi.org/10.1109/78.978374
  2. R. Hsu, M. Mottaleb and A. Jain, "Face detection in color images," IEEE Trans. on Patterns on Analysis and Machine Intelligence, vol.24, no.5, pp.696-706, May.2002. https://doi.org/10.1109/34.1000242
  3. B. Heisele, T. Serre, M. Pontil and T. Poggio, "Component-based face detection," in Proc. of the 2001 IEEE Conf. on Computer Vision and Pattern Recognition, pp.657-662, 2001.
  4. F. Xu, X. Liu and K. Fujimura, "Pedestrian detection and tracking with night vision," IEEE Trans. on Intelligent Transportation Systems, vol.6, no.1, pp.63-71, Mar.2005. https://doi.org/10.1109/TITS.2004.838222
  5. R.J. Radke, S. Andra, O. A. Kofahi and B. Roysam, "Image change detection algorithms: A survey," IEEE Trans. on Image Processing, vol.14, no.3, pp.294-307, Mar.2005. https://doi.org/10.1109/TIP.2004.838698
  6. Y. Wu and T.S. Huang, "Recent development in human motion analysis," Pattern Recognition, vol.36, no.3, pp.585-601, Mar.2003. https://doi.org/10.1016/S0031-3203(02)00100-0
  7. R. Bodor, B. Jackson and N. Papanikolopoulos, "Vision-based human tracking and activity recognition," in Proc. of the 11th Mediterranean Conference on Control and Automation, pp.18-20, Jun.2003.
  8. O. Javed, K. Shafique and M. Shah, "Hierarchical approach to robust background subtraction using color and gradient information," in Proc. of the IEEE Workshop on Motion and Video Computing, pp.22-27, Dec.2002.
  9. Y. Matsushita, K. Nishino, K. Ikeuchi and M. Sakauchi, "Illumination normalization with time-dependent intrinsic images for video surveillance," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.26, no.10, pp.1336-1347, Oct.2004. https://doi.org/10.1109/TPAMI.2004.86
  10. C. Stauffer and W. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol.22, no.8, pp.747-757, Aug.2000. https://doi.org/10.1109/34.868677
  11. M. Shah, O. Javed and K. Shafique, "Automated visual surveillance in realistic scenarios," IEEE Multimedia, vol.14, no.1, pp.30-39, Mar.2007. https://doi.org/10.1109/MMUL.2007.3
  12. R. Collins, Y. Liu and M. Leordeanu, "On-line selection of discriminative tracking features," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.27, no.10, pp.1631-1643, Oct.2005. https://doi.org/10.1109/TPAMI.2005.205
  13. S. Avidan, "Ensemble Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.29, no.2, pp.261-271, Feb.2007. https://doi.org/10.1109/TPAMI.2007.35
  14. F. Tang and H. Tao, "Probabilistic object tracking with dynamic attributed relational feature graph," IEEE Transactions on Circuits and Systems for Video Technology, vol.18, no.8, pp.1064-1074, Aug.2008. https://doi.org/10.1109/TCSVT.2008.927106
  15. T. Yang, S. Li, Q. Pan and J. Li, "Real-time multiple objects tracking with occlusion handling in dynamic scenes," in Proc. of the 2005 IEEE Conf. on Computer Vision and Pattern Recognition, pp.970-975, Jun.2005.
  16. A. Senior, "Tracking people with probabilistic appearance models," in Proc. of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance, pp.48-55, 2002.
  17. D. Greenhill, J. Renno, J. Orwell and G.A. Jones, "Occlusion analysis: Learning and utilizing depth maps in object tracking," in Proc. of Annual British Machine Vision Conf., vol.26, no.3, pp.430-441, Mar.2008.
  18. W. Hu, T. Tan, L. Wang and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Transactions on Information Systems, Man, And Cybernetics - Part C: Applications and Reviews, vol.34, no 3, pp.334-352, Aug.2004. https://doi.org/10.1109/TSMCC.2004.829274
  19. S. Chien, Y. Huang, B. Hsieh, S. Ma and L. Chen, "Fast video segmentation algorithm with shadow cancellation, global motion compensation and adaptive threshold techniques," IEEE Transactions on Multimedia, vol.6, no.5, pp.732-748, Oct.2004. https://doi.org/10.1109/TMM.2004.834868
  20. M. Pollefeys, R. Koch and L. V. Gool, "Self-calibration and metric reconstruction in spite of varying and unknown intrinsic camera parameters," in Proc. of the Sixth International Conference on Computer Vision, pp.90-95, Jan.1998.
  21. Z. Chair and P. K. Varshney, "Optimal data fusion in multiple sensor detection systems," IEEE Transactions on Aerospace and Electronic Systems, vol.22, no.1, pp.98-101, Jan.1986.
  22. X. R. Li and V. P. Jilkov, "Survey of maneuvering target tracking-Part I," IEEE Trans. on Aerospace and Electronic Systems, vol.39, no.4, pp.1333-1364, Oct.2003. https://doi.org/10.1109/TAES.2003.1261132
  23. Y. B. Shalom and W. D. Blair, Multitarget-Multisensor Tracking: Applications and Advances, Artech House Publishers, 2000.
  24. D. B. Ward, E. A. Lehmann and R. C. Williamson "Particle filtering algorithms for tracking an acoustic source in a reverberant environment," IEEE Trans. Speech and Audio Processing, vol.11, no 6, pp.826-836, Nov.2003. https://doi.org/10.1109/TSA.2003.818112
  25. J. Lim, J. Lee, S. Hong and P. Park, "Algorithm for detection with localization of multi-targets in wireless acoustic sensor networks," in Proc. of the 18th IEEE Int. Conference on Tools with Artificial Intelligence, pp.547-554, Nov.2006.
  26. M. S. Arulampalam, B. Ristic, N. Gordon and T. Mansell, "Bearings-only Tracking of Manoeuvring targets using particle filters," EURASIP Journal on Applied Signal Processing, vol.2004, no.1, pp.2351-2365, Jan.2004.
  27. Z. Jin, Z Lou, J. Yang and Q. Sun, "Face detection using template matching and skin-color information", Neurocomputing, vol.70, no.4-6, pp.794-800, Jan.2007. https://doi.org/10.1016/j.neucom.2006.10.043
  28. K. Park, J. Lee, M. Stanacevic, S. Hong and W. Cho, "Iterative object localization algorithm using visual images with a reference coordinate", EURASIP Journal on Image Video Processing, Article ID 256896, vol.2008.
  29. S. H. Cho, Y. Nam, S. Hong and W. D. Cho, "Locally initiating line-based object association in large scale multiple cameras environment," KSII Transactions on Internet and Information Systems, vol.4, no.3, pp.358-379, Jun.2010.
  30. S. H. Cho, Y. Nam and S. Hong, "Multiple camera collaboration strategies for dynamic object association," KSII Transactions on Internet and Information Systems, vol.4, no.6, pp.1169-1193, Dec.2010.