International Journal of Fuzzy Logic and Intelligent Systems

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Occluded Object Motion Estimation System based on Particle Filter with 3D Reconstruction

  • Ko, Kwang-Eun (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Park, Jun-Heong (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Park, Seung-Min (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Kim, Jun-Yeup (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Sim, Kwee-Bo (School of Electrical and Electronics Engineering, Chung-Ang University)
  • Received : 2012.02.28
  • Accepted : 2012.03.15
  • Published : 2012.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a method for occluded object based motion estimation and tracking system in dynamic image sequences using particle filter with 3D reconstruction. A unique characteristic of this study is its ability to cope with partial occlusion based continuous motion estimation using particle filter inspired from the mirror neuron system in human brain. To update a prior knowledge about the shape or motion of objects, firstly, fundamental 3D reconstruction based occlusion tracing method is applied and object landmarks are determined. And optical flow based motion vector is estimated from the movement of the landmarks. When arbitrary partial occlusions are occurred, the continuous motion of the hidden parts of object can be estimated by particle filter with optical flow. The resistance of the resulting estimation to partial occlusions enables the more accurate detection and handling of more severe occlusions.

Keywords

References

  1. T. Yang, Q. Pan, J. Li, S.Z. Li, Real-time multiple objects tracking with occlusion handling in dynamic scenes, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005 (CVPR 2005), vol. 1, pp. 970-975, June 20-25, 2005.
  2. H. T. Nguyen, A. W. M. Smeulders, "Fast occluded object tracking by a robust appearance filter," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 1099-1104, August 2004. https://doi.org/10.1109/TPAMI.2004.45
  3. G. Rizzolatti and L. Craighero, "The mirror-neuron system.," Annual review of neuroscience, vol. 27, pp. 169- 92, Jan. 2004. https://doi.org/10.1146/annurev.neuro.27.070203.144230
  4. D.-hun Lee, D.-youn Um, and H. Kang, "A Study of the 3D-Reconstruction of indoor using Stereo Camera System," Journal of Korean Institute of Intelligent Systems, vol. 15, no. 1, pp. 42-47, 2005. https://doi.org/10.5391/JKIIS.2005.15.1.042
  5. A. Blake, R. Curwen, and A. Zisserman, "A framework for spatio-temporal control in the tracking of visual contour," International Journal of Computer Vision, vol.11, no. 2, pp. 127-145, 1993. https://doi.org/10.1007/BF01469225
  6. D. G. Lowe, "Object recognition from local scale-invariant features," Proc. the Seventh IEEE International Conference on Computer Vision, pp. 1150-1157 vol.2, 1999.
  7. D. G. Lowe, "Distinctive Image Features from Scale- Invariant Keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, Nov. 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  8. S. Beauchemin, J. Barron, and D. Fleet, "Systems and experiment performance of optical flow techniques," Int. J. Comput. Vision, vol. 12, no. 1, pp. 43-77, 1994. https://doi.org/10.1007/BF01420984
  9. J. Chun and G. Shin, "Realtime Facial Expression Recognition from Video Sequences Using Optical Flow and Expression HMM," Journal of Korean Society for Internet Information, vol. 12, no. 3, pp. 55-70, 2011.
  10. P. Hargrave, "A tutorial introduction to Kalman filtering," Kalman Filters: Introduction, Applications and, pp. 1- 6, 1989.
  11. Y. Wu, T. Yu, G. Hua, "Tracking appearance with occlusions" Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 789-795, 2003.
  12. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 174- 188, 2002. https://doi.org/10.1109/78.978374
  13. H. B. Kim, K. E. Ko, J. S. Kang, K.-B. Sim, "Specified Object Tracking in an Environment of Multiple Moving Objects using Particle Filter," Journal of Korean Institute of Intelligent Systems, vol. 21, no. 1, pp. 106-111, 2011. https://doi.org/10.5391/JKIIS.2011.21.1.106
  14. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989. https://doi.org/10.1109/5.18626
  15. J. H. Park, S. M. Park, K. E. Ko, K. B. Sim, "Occluded object motion tracking method based on combination of 3D reconstruction and optical flow," International Symposium on Advanced Intelligent Systems, Suwon, Korea, Oct. 2011.
  16. N. Bouaynaya, D. Schonfeld, "A complete system for head tracking using motion-based particle filter and randomly perturbed active contour," Proc. SPIE, vol. 5685, pp.864 - 873 , 2005.