A Study on Detecting Moving Objects using Multiple Fisheye Cameras

다중 어안 카메라를 이용한 움직이는 물체 검출 연구

  • Bae, Kwang-Hyuk (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center) ;
  • Suhr, Jae-Kyu (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center) ;
  • Park, Kang-Ryoung (Dept. of Electronics Engineering, Dongguk University, Biometrics Engineering Research Center) ;
  • Kim, Jai-Hie (School of Electrical and Electronic Engineering, Yonsei University, Biometrics Engineering Research Center)
  • 배광혁 (연세대학교 전기전자공학과, 생체인식연구센터) ;
  • 서재규 (연세대학교 전기전자공학과, 생체인식연구센터) ;
  • 박강령 (동국대학교 전자공학과, 생체인식연구센터) ;
  • 김재희 (연세대학교 전기전자공학과, 생체인식연구센터)
  • Published : 2008.07.25

Abstract

Since vision-based surveillance system uses a conventional camera which has a narrow field of view, it is difficult to apply it into the environment whose the ceiling is low and the monitoring area is wide. To overcome this problem, the method of increasing the number of camera causes the increase of the cost and the difficulties of camera set-up For these problems, we propose a new surveillance system based on multiple fisheye cameras which have 180 degree field of view. The proposed method handles occlusions using the homography relation between the multiple fisheye cameras. In the experiment, four fisheye cameras were set up within the area of $17{\times}14m$ at height of 2.5 m and five people wandered and crossed with one another within this area. The detection rates of the proposed system was 83.0% while that of a single camera was 46.1%.

기존의 보안 감시 시스템은 화각이 좁은 일반 렌즈를 주로 사용하여 천정이 낮고 실내가 넓은 환경에 적용하기가 어려웠다. 이를 해결하기 위해 단순히 카메라의 수를 늘리는 방법은 비용의 증가와 설치의 어려움 등의 문제가 있다. 따라서 본 논문에서는 화각이 180도인 어안 카메라를 다수 설치한 사용자 감시 시스템을 제안하였다. 단일 어안 카메라에서 물체간의 교차에 의한 가림현상이 발생되는 문제를 해결하기 위해서 카메라간의 상동관계를 다중 어안 카메라 시스템에 적용하였다. $17{\times}14m$의 공간의 2.5m 높이에 설치된 4대의 어안 카메라에서 5명이 서로 교차하면서 움직이도록 하여 수행한 결과, 단일 어안카메라에서 최대 46.1% 낮은 검출율을 보인 반면 제안된 시스템에서 83.0%로 향상된 성능을 보였다.

Keywords

References

  1. 배광혁, 박강령, 김재희, "전 방향 카메라 영상에서 사람의 얼굴 위치검출 방법", 대한전자공학회 하계종합학술대회, 30권, 1호, 2007
  2. K. Bae, K. R. Park, and J. Kim, "3D Head Position Estimation using a Single Omnidirectional Camera for Non-intrusive Iris Recognition", MRCS 2006, LNCS, Vol. 4105, pp. 167-174, 2006
  3. K. Bae, K. R. Park, and J. Kim, "Tracking Head Positions in Three Dimensional Space by Using a Single Omnidirectional Camera", Optical Engineering, Vol. 47, No. 4, 2008
  4. W. Hu, T. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors", IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Reviews, Vol. 34, no. 3, pp. 334-352, 2004 https://doi.org/10.1109/TSMCC.2004.829274
  5. W. Hu, M. Hu, X. Zhou, T. Tan, J. Lou, and S. Maybank, "Principal axis-based correspondence between multiple cameras for people tracking", IEEE Trans. Pattern Recognition and Machine Intelligence, Vol. 28, no. 4, pp. 663-670, 2006 https://doi.org/10.1109/TPAMI.2006.80
  6. L. Lee, R. Romano, and G. Stein, "Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame", IEEE Trans. Pattern Recognition and Machine Intelligence, Vol. 22, no. 8, pp. 758-767, 2000 https://doi.org/10.1109/34.868678
  7. K. Kim and L. S. Davis, "Multi-camera Tracking and Segmntation of Occluded People on Ground Plane Using Search-Guided Particle Filtering", ECCV 2006, Part III, LNCS, Vol. 3953, pp. 98-109, 2006
  8. W. Du and J. Piater, "Muti-camera People Tracking by Collaborative Particle Filters and Principal Axis-Baed Integration", ACCV 2007, Part I, LNCS, Vol. 4843, pp. 365-374, 2007
  9. E. Garcia and L. Altamirano, "Decision Level Multiple Camera Fusion Using Dezert- Smarandache Theory", CAIP 2007, LNCS, Vol. 4673, pp. 117-124, 2007
  10. S. S. Brandt, "A Generic Camera Model and Calibration Method for Conventional, Wide-Angle, and Fish-Eye Lenses", IEEE Trans. Pattern Recognition and Machine Intelligence, Vol. 28, no. 8, pp. 1335-1340, 2006 https://doi.org/10.1109/TPAMI.2006.153
  11. T. Horprasert, D. Harwood, and L.S. Davis, "A statisticalapproachfor real-time robust background subtraction and shadow detection," in Proc. IEEE ICCV'99 FRAME-RATE Workshop, 1999
  12. P. KaewTraKulPong and R. Bowden, "An Inproved Adaptive Background Mixture Model for Realtime Tracking with Shadow Detection," in Proc. European Workshop on Advanced Video Based Surveillance Systems (AVBS01), 2001
  13. R. Hartley and A. Zisserman, Multiple View Geometry in computer vision, Cambridge University Press, 2003
  14. http://www.fujinon.com/ (accessed on 2008.02.26)