A Shadow Region Suppression Method using Intensity Projection and Converting Energy to Improve the Performance of Probabilistic Background Subtraction

확률기반 배경제거 기법의 향상을 위한 밝기 사영 및 변환에너지 기반 그림자 영역 제거 방법

  • Published : 2010.01.01


The segmentation of moving object in video sequence is a core technique of intelligent image processing system such as video surveillance, traffic monitoring and human tracking. A typical method to segment a moving region from the background is the background subtraction. The steps of background subtraction involve calculating a reference image, subtracting new frame from reference image and then thresholding the subtracted result. One of famous background modeling is Gaussian mixture model (GMM). Even though the method is known efficient and exact, GMM suffers from a problem that includes false pixels in ROI (region of interest), specifically shadow pixels. These false pixels cause fail of the post-processing tasks such as tracking and object recognition. This paper presents a method for removing false pixels included in ROT. First, we subdivide a ROI by using shape characteristics of detected objects. Then, a method is proposed to classify pixels from using histogram characteristic and comparing difference of energy that converts the color value of pixel into grayscale value, in order to estimate whether the pixels belong to moving object area or shadow area. The method is applied to real video sequence and the performance is verified.


  1. W. E. L. Grimson, C. Stauffer, R. Romano, and L. Lee. "Using adaptive tracking to classify and monitor activities in a site," IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp. 22-29, June 1998.
  2. C. Stauffer and W. E. L. Grimson, "Adaptive background mixture models for real-time tracking," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, June 1999.
  3. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 22, no. 8, pp. 747-57, Aug. 2000.
  4. N. Friedman and S. Russell, "Image segmentation in video sequences: a probabilistic approach," in The Thirteenth Conference on Uncertainty in Artificial Intelligence. Brown University, Providence, Rhode Island, USA: Morgan Kaufmann Publishers, Inc., San Francisco, 1997.
  5. D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, and S. Russell, "Towards robust automatic traffic scene analysis in realtime," IEEE 12th IAPR International Conference on Pattern Recognition. vol. 1, pp. 126-131, Oct. 1994.
  6. C. Ridder, O. Munkelt, and H. Kirchner, "Adaptive background estimation and foreground detection using kalman-filtering," International Conference on recent Advances in Mechatronics, ICRAM'95, UNESCO Chair on Mechatronics, pp. 193-199, 1995.
  7. A. Elgarnmal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," Proc. Sixth European Conf. Computer Vision, vol. 2, pp. 751-767, June 2000.
  8. P. KaewTraKulPong, R. Bowden, "An improved adaptive background mixture model for real-time tracking with shadow detection," in Proceedings of the 2nd European Workshop on Advanced Video-Based Surveillance Systems, Sept. 2001.
  9. L. Li, W. Huang, Y. G. Irene, and Q. Tian, "Foreground object detection from videos containing complex background," ACM Multimedia, pp. 2-10, Nov. 2003.
  10. T. Horprasert, D. Harwood, and L. S. Davis, "A statistical approach for real-time robust background subtraction and shadow detection," Proc. IEEE Int'l Conf. Computer Vision '99 FRAME-RATE Workshop, 1999.
  11. C. Jiang and M. O. Ward, "Shadow Segmentatin and Classification in a Constrained Environment," CVGIP : Image Understanding, vol. 59, no. 2, pp. 213-225, 1994.
  12. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, "Detecting moving objects, ghosts and shadows in video streams," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no 10, pp. 1337-1342, Oct. 2003.
  13. A. H. Yoneyarna, C. Yeh, and C. C. J. Kuo, "Moving cast shadow elimination for robust vehicle extraction based on 2D joint vehicle/shadow models," IEEE, 2003.
  14. 이상주, 황동국, 최동진, 이우람, 박희정, 전병민, "컬러 특성을 이용한 그림자 영역 검출," 한국콘텐츠학회 논문지, 제5권 제4호, pp. 103-110, 2005.
  15. 박수우, 김정대, 도용태, "비디오 카메라 영상 내 동적 물체의 그림자 화소 검출 기법," 멀티미디어학회 논문지, 제8권 제10호, pp. 1314-1321, 2005.
  16. 최혜승, 왕아곤, 소영성, "물체 색정보와 예전 제거기록을 활용하는 새로운 그림자 제거방법," 정보처리학회 논문지B,12-B권, 4호, pp. 395-402, 2005.
  17. R. M. Neal and G. E. Hinton, "A view of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in Graphical Models, M. I. Jordan, Editor, Dordrecht: Kluwer Academic Publishers, pp. 355-368, 1998.
  18. J. Stauder, R. Mech, and J. Ostermann, "Detection of moving cast shadows for object segmentation," IEEE Transactions on Multimedia, vol. 1, no. 1, pp. 65-76, Mar. 1999.
  19. A. Prati, I. Mikic, M. Trivedi, and R. Cucchiara, "Detecting moving shadows: Algorithms and evaluation," IEEE Transactions on Pattern Analysis Machine Intelligence, vol. 25, no. 7, pp. 918-923, Jul. 2003.

Cited by

  1. Removing Shadows Using Background Features in the Images of a Surveillance Camera vol.19, pp.3, 2013,