KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Probabilistic Background Subtraction in a Video-based Recognition System

  • Lee, Hee-Sung (Samsung S1 Co., Ltd.) ;
  • Hong, Sung-Jun (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kim, Eun-Tai (School of Electrical and Electronic Engineering, Yonsei University)
  • Received : 2011.01.24
  • Accepted : 2011.04.14
  • Published : 2011.04.29
Download PDF
⟨ Previous Next ⟩

Abstract

In video-based recognition systems, stationary cameras are used to monitor an area of interest. These systems focus on a segmentation of the foreground in the video stream and the recognition of the events occurring in that area. The usual approach to discriminating the foreground from the video sequence is background subtraction. This paper presents a novel background subtraction method based on a probabilistic approach. We represent the posterior probability of the foreground based on the current image and all past images and derive an updated method. Furthermore, we present an efficient fusion method for the color and edge information in order to overcome the difficulties of existing background subtraction methods that use only color information. The suggested method is applied to synthetic data and real video streams, and its robust performance is demonstrated through experimentation.

Keywords

References

  1. A. Elgammal, R. Duraiswami, D. Harwood and L. S. Davis, "Background and foreground modeling using nonparametric kernel density estimation for visual surveillance," in Proc. IEEE, vol. 90, pp. 1151-1163, Jul. 2002. https://doi.org/10.1109/JPROC.2002.801448
  2. I. Hariaoglu, D. Harwood and L. S. Davis, "W4: real-time surveillance of people and their activities," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809-830, Aug. 2000. https://doi.org/10.1109/34.868683
  3. N. Friedman and S. Russell, "Image segmentation in video sequences: a probabilistic approach," in Proc. the 13th Conf. Uncertainty in Artificial intelligence, 1997.
  4. S. Arseneau and J. R. Cooperstock, "Real-time image segmentation for action recognition," in Proc. IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, 1999.
  5. H. Lee, S. Hong and E. Kim, "An efficient gait recognition based on a selective neural network ensemble," International Journal of Imaging Systems and Technology, vol. 18, no. 4, pp. 237-241, Oct. 2008. https://doi.org/10.1002/ima.20136
  6. H. Lee, S. Hong and E. Kim, "Neural network ensemble with probabilistic fusion and its application to gait recognition," Neurocomputing, vol. 72, pp. 1557-1564, Mar. 2009. https://doi.org/10.1016/j.neucom.2008.09.009
  7. N. M. Oliver, B. Rosario and A. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 831-843, Aug. 2000. https://doi.org/10.1109/34.868684
  8. V. I. Pavlovic, R. Sharma and T. S. Huang, "Visual interpretation of hand gestures for human-computer interaction: a review," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 677-695, Jul. 1997. https://doi.org/10.1109/34.598226
  9. T. Horpraser, D. Harwood and L. S. Davis, "A statistical approach for real-time robust background subtraction and shadow detection," in Proc. International Conference on Computer Vision, 1999.
  10. V. Mahadevan and N. Vasconcelos, "Background subtraction in highly dynamic scenes," in Proc. IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1-6, 2008.
  11. A. Neri, S. Colonnese, G. Russo and P. Talone, "Automatic moving object and background separation," Signal Processing, vol. 66, no. 2, pp. 219-232, Apr. 1998. https://doi.org/10.1016/S0165-1684(98)00007-3
  12. J. Nascimento and J. S. Marques, "Performance evaluation of object detection algorithms for video surveillance," IEEE Transactions on Multimedia, vol. 8, no. 4, pp. 761-774, Aug. 2006. https://doi.org/10.1109/TMM.2006.876287
  13. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE International Conference on Computer Vision and Pattern Recognition, vol. 2, pp.246-252, 1999.
  14. O. Javed, K. Shafique and M. Shah, "A hierarchical approach to robust background subtraction using color and gradient information," in Proc. the Workshop on Motion and Video Computing, pp. 22-27, Dec. 2002.
  15. D. Lee, J. Hull and B. Erol, "A Bayesian framework for Gaussian mixture background modeling," in Proc. IEEE International Conference on Image Processing, vol. 3, pp. 973-976, Sept. 2003.
  16. F. Porikli and O. Tuzel, "Human body tracking by adaptive background models and mean-shift analysis," in Proc. IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, pp. 37-45, Mar. 2003.
  17. G. Dally, J. Migdal and W. Grimson, "Background subtraction for temporally irregular dynamic textures," in Proc. IEEE Workshop on Applications of Computer Vision, pp. 1-7, 2008.
  18. Z. Zivkovic "Improved adaptive Gaussian mixture model for background subtraction," in Proc. IEEE International Conference on Pattern Recognition, vol. 2, pp. 28-31, Aug. 2004.
  19. A. Mittal and N. Paragios, "Motion-based background subtraction using adaptive kernel density estimation," in Proc. IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 302-309, 2004.
  20. K. Kim, T. Chalidabhongse, D. Harwood and L.S. Davis, "Real-time foreground-background segmentation using codebook model," Real-time imaging, vol. 11, pp. 167-256, Jun. 2005. https://doi.org/10.1016/j.rti.2005.06.001
  21. X. Zhang and J. Yang, "The analysis of the color similarity problem in moving object detection," Signal Processing, vol. 89, no. 4, pp. 685-691, 2009. https://doi.org/10.1016/j.sigpro.2008.10.027
  22. M. Mason and Z. Duric, "Using histograms to detect and track objects in color video," in Proc. Applied Imagery Pattern Recognition Workshop, pp. 154-159, 2001.
  23. S. Jabri, Z. Duric, H. Wechsler and A. Rosenfeld, "Detection and location of people in video images using adaptive fusion of color and edge information," in Proc. International Conference on Pattern Recognition, vol. 4, pp. 627-630, 2000.
  24. L. Wixson, "Detecting salient motion by accumulating directionally-consistent flow," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 774-780, Aug. 2000. https://doi.org/10.1109/34.868680
  25. M. Heikkila and M. Pietikainen "A texture-based method for modeling the background and detecting moving objects," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, pp. 657-662, Apr. 2006. https://doi.org/10.1109/TPAMI.2006.68
  26. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance," in Proc. IEEE International Conference on Computer Vision, vol.1, pp. 255-261, 1999.
  27. A. Monnet, A. Mittal, N. Paragios and V. Ramesh, "Background modeling and subtraction of dynamic scenes," in Proc. IEEE International Conference on Computer Vision, vol. 2, pp.1305-1312, 2003.
  28. E. Kim, M. Park, S. Ji and M. Park, "A new approach to fuzzy modeling," IEEE Transactions on Fuzzy Systems, vol. 5, no. 3, pp. 328-337, Aug. 1997. https://doi.org/10.1109/91.618271
  29. L.-X.Wang, A Course in Fuzzy Systems and Control, Prentice-Hall International Inc., 1997.
  30. T. B. Moeslund, A. Hilton and V. Kruger, "A survey of advances in video-based human motion capture analysis," Computer Vision and Image Understanding, vol. 104, pp. 90-126, 2006. https://doi.org/10.1016/j.cviu.2006.08.002
  31. G. Bradski, A. Kaehler and V. Pisarevsky, "Learning-based computer vision with Intel's open source computer vision library" Intel Technology Journal, vol. 9, 2005.
  32. J. Kim and C. Lee, "Bayesian rule-based complex background modeling and foreground detection," Optical Engineering, vol. 49, no. 2, 027006, 2010. https://doi.org/10.1117/1.3319820
  33. D. Olson and D. Delen, "Advanced data mining techniques," Springer, 2008.

Cited by

  1. 재귀적 확률 갱신 방법을 이용한 보행자 충돌 위험 판단 방법 vol.21, pp.4, 2011, https://doi.org/10.5391/jkiis.2011.21.4.475
  2. A Novel Video Image Text Detection Method vol.6, pp.3, 2011, https://doi.org/10.3837/tiis.2012.03.010
  3. A Novel Video Image Text Detection Method vol.6, pp.4, 2011, https://doi.org/10.3837/tiis.2012.04.011
  4. Novel Intersection Type Recognition for Autonomous Vehicles Using a Multi-Layer Laser Scanner vol.16, pp.7, 2016, https://doi.org/10.3390/s16071123