KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Locally Initiating Line-Based Object Association in Large Scale Multiple Cameras Environment

  • Cho, Shung-Han (Mobile Systems Design Laboratory, Dept. of Electrical and Computer Engineering, Stony Brook University-SUNY) ;
  • Nam, Yun-Young (Mobile Systems Design Laboratory, Dept. of Electrical and Computer Engineering, Stony Brook University-SUNY) ;
  • Hong, Sang-Jin (Mobile Systems Design Laboratory, Dept. of Electrical and Computer Engineering, Stony Brook University-SUNY) ;
  • Cho, We-Duke (Dept. of Electrical and Computer Engineering, Ajou University)
  • Received : 2010.04.06
  • Accepted : 2010.06.18
  • Published : 2010.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Multiple object association is an important capability in visual surveillance system with multiple cameras. In this paper, we introduce locally initiating line-based object association with the parallel projection camera model, which can be applicable to the situation without the common (ground) plane. The parallel projection camera model supports the camera movement (i.e. panning, tilting and zooming) by using the simple table based compensation for non-ideal camera parameters. We propose the threshold distance based homographic line generation algorithm. This takes account of uncertain parameters such as transformation error, height uncertainty of objects and synchronization issue between cameras. Thus, the proposed algorithm associates multiple objects on demand in the surveillance system where the camera movement dynamically changes. We verify the proposed method with actual image frames. Finally, we discuss the strategy to improve the association performance by using the temporal and spatial redundancy.

Keywords

References

  1. W. Hu, T. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Trans. on Systems, Man, and Cybernetics - Part C: Applications and Reviews, vol. 34, no. 3, pp. 334-352, Aug. 2004. https://doi.org/10.1109/TSMCC.2004.829274
  2. A. Utsumi, H. Mori. J. Ohya, and M. Yachida, "Multiple-view-based tracking of multiple humans," in Proc. of Int'l Conf. Pattern Recognition, pp.197-601, 1998.
  3. S. L. Dockstader and A. M. Tekalp, "Multiple camera tracking of interacting and occluded human motion," Proceedings of the IEEE, vol. 89, no. 10, pp. 1441-1455, Oct. 2001. https://doi.org/10.1109/5.959340
  4. S. Khan and M. Shah, "Consistent labeling of tracked objects in multiple cameras with overlapping fields of view," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1355-1360, Oct. 2003. https://doi.org/10.1109/TPAMI.2003.1233912
  5. S. Calderara, A. Prati, R. Vezzani, and R. Cucchiara, "Consistent labeling for multi-camera object tracking," in Proc. of Image Analysis and Processing (ICIAP), pp. 1206-1214, 2005.
  6. J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale, and S. Shafer, "Multi-camera multi-person tracking for easy living," in Proc. of IEEE Int'l Workshop Visual Surveillance, Dublin, Ireland, pp. 3-10, Jul. 2000.
  7. J. Li, C.S. Chua, and Y.K. Ho, "Color based multiple people tracking," in Proc. of IEEE Int'l Conf. on Control, Automation, Robotics and Vision, vol. 1, pp. 309-314, 2002.
  8. Q. Cai and J. K. Aggarwal, "Tracking human motion using multiple cameras," in Proc. of Int'l Conf. on Pattern Recognition ,Vienna, Austria, pp. 68-72, 1996.
  9. Y. Caspi, D. Simakov and M. Irani, "Feature-based sequence-to-sequence matching," International Journal of Computer Vision, pp. 53-64, 2006.
  10. J. Orwell, P. Remagnino and G.A. Jones, "Multiple camera color tracking," IEEE Int'l Workshop Visual Surveillance, pp. 14-24, Jun. 1999.
  11. A. Mittal and L.S. Davis, "M2Tracker: A multi-view approach to segmenting and tracking people in a cluttered scene using region-based stereo," in Proc. of European Conf. Computer Vision, pp. 18-36, May 2002.
  12. J. Kang, I. Cohen, and G. Medioni. "Continuous tracking within and across camera streams," in Proc. of IEEE Int'l Conference on Computer Vision and Pattern Recognition, vo.1, pp.267-272, 2003.
  13. S. Chang and T.-H. Gong. "Tracking multiple people with a multi-camera system," in Proc. of IEEE Workshop on Multi-Object Tracking, pp. 19-26, 2001.
  14. S. H. Cho, S. Hong. W. Cho, "Homographic line generation and transformation technique for dynamic object association," in Proc. of Int'l Workshop on Machine Learning for Signal Processing, pp. 273-278, Oct. 2008.
  15. K. S. Park, J. Lee, M. Stanaćević, S. Hong and W. D. Cho, "Iterative object localization algorithm using visual images with a reference coordinate," EURASIP Journal on Image and Video Processing, vol. 2008, Article ID 256896, July 2008.
  16. W. Hu, M. Hu, X. Zhou, T. Tan, J. Lou and S. Maybank, "Principal axis-based correspondence between multiple cameras for people tracking," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 663-671, Apr. 2006. https://doi.org/10.1109/TPAMI.2006.80
  17. H. Tsutsui, J. Miura and Y. Shirai, "Optical flow-based person tracking by multiple cameras," in Proc. of IEEE Conf. Multisensor Fusion and Integration in Intelligent Systems, pp. 91-96, Aug. 2001.
  18. A. Utsumi, H. Mori, J. Ohya and M. Yachida, "Multiple human tracking using multiple cameras," in Proc. of IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 498-503, Apr. 1998.
  19. J. Black and T. Ellis, "Multi camera image tracking," Image and Vision Computing, vol. 24, pp. 1256-1267, 2006. https://doi.org/10.1016/j.imavis.2005.06.002
  20. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 2000. https://doi.org/10.1109/34.888718
  21. L. Lucchese, "Geometric calibration of digital cameras through multi-view rectification," Image and vision computing, vol. 23, no. 5, pp. 517-539, May 2005. https://doi.org/10.1016/j.imavis.2005.01.001
  22. J. Wang, F. Shi, J. Zhang and Y. Liu, "A new calibration model of camera lens distortion," Pattern Recognition, vol. 41, no. 2, pp. 607-615, Feb. 2008. https://doi.org/10.1016/j.patcog.2007.06.012
  23. J. Heikkila and O. Silven, "A four-step camera calibration procedure with implicit image correlation," in Proc. of Conf. on Computer Vision and Pattern Recognition, pp. 1106-1112, 1997.
  24. R. Hassanpour, Volkan Atalay, "Camera auto-calibration using a sequence of 2D images with small rotations," Pattern Recognition Letters, vol. 25 pp. 989-997, 2004. https://doi.org/10.1016/j.patrec.2004.02.011
  25. S. Z. Li and Z.Q. Zhang, "FloatBoost learning and statistical face detection," IEEE Trans. on Patteran Analysis and Machine Intelligence, vol. 26. no. 9, pp. 1112-1123, Sep. 2004. https://doi.org/10.1109/TPAMI.2004.68
  26. P. Viola and M. J. Jones, "Robust real-time face detection," International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, May 2004.

Cited by

  1. Local and Global Information Exchange for Enhancing Object Detection and Tracking vol.6, pp.5, 2010, https://doi.org/10.3837/tiis.2012.05.009
  2. Trajectory based database management for intelligent surveillance system with heterogeneous sensors vol.75, pp.23, 2010, https://doi.org/10.1007/s11042-015-2725-z