DOI QR코드

DOI QR Code

Mixing Collaborative and Hybrid Vision Devices for Robotic Applications

로봇 응용을 위한 협력 및 결합 비전 시스템

  • Received : 2011.02.15
  • Accepted : 2011.05.16
  • Published : 2011.08.31

Abstract

This paper studies how to combine devices such as monocular/stereo cameras, motors for panning/tilting, fisheye lens and convex mirrors, in order to solve vision-based robotic problems. To overcome the well-known trade-offs between optical properties, we present two mixed versions of the new systems. The first system is the robot photographer with a conventional pan/tilt perspective camera and fisheye lens. The second system is the omnidirectional detector for a complete 360-degree field-of-view surveillance system. We build an original device that combines a stereo-catadioptric camera and a pan/tilt stereo-perspective camera, and also apply it in the real environment. Compared to the previous systems, we show benefits of two proposed systems in aspects of maintaining both high-speed and high resolution with collaborative moving cameras and having enormous search space with hybrid configuration. The experimental results are provided to show the effectiveness of the mixing collaborative and hybrid systems.

Acknowledgement

Supported by : NIPA(National IT Industry Promotion Agency)

References

  1. Z. Byers, M. Dixon, K. Goodier, W. Smart, and C. Grimm, "Say cheese! experiences with a robot photographer," AI Magazine, Vol.25, No.2, pp.37-46, 2004
  2. H.-S. Ahn, M.-J. Lee, I.-K. Jeong, and J.-H. Park, "A smart agent for taking pictures," SIGGRAPH ASIA, 2009.
  3. J. Y. Bouguet. Camera calibration toolbox for matlab. URL: http://www.vision.caltech.edu/bougu etj/calib_doc/#examples
  4. Paul Viola and Michael Jones, "Robust real-time face detection," IJCV, Vol.57, No.2, pp.137-154, 2004. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  5. Y.D. Seo, Y.J. Choi and S.W. Lee. A branch-and-bound algorithm for globally optimal calibration of a camera-and-rotation-sensor system. International Conference on Computer Vision, 2009.
  6. Branko Ristic, Sanjeev Arulampalam and Neil Gordon. Beyond the Kalman Filter. Artech House, London, 2004.
  7. A. Doucet, N. De Freitas and N. Gordon. Sequential Monte Carlo Methods in Practice. Springer-Verlag, 2001.
  8. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry and Y. Ma, "Robust face recognition via sparse representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.31, No.2, pp.210-227, 2009.
  9. Y. Onoe, K. Yamazawa, N. Yokoya and H. Takemura, "Visual surveillance and monitoring system using an omnidirectional video camera," International Conference on Pattern Recognition, 1998.
  10. Y. Onoe, K. Yamazawa, N. Yokoya and H. Takemura, "Visual surveillance and monitoring system using an omnidirectional video camera," International Conference on Pattern Recognition, 1998.
  11. H. Liu, O. Javed, G. Taylor, X. Cao and N. Haering, "Omni-directional surveillance for unmanned water vehicles," VS, 2008.
  12. W. K. Wong, Joanne T. Y. Liew, C. K. Loo and Wei Kin Wong, "Omnidirectional surveillance system for digital home security," ICSAP, 2009.
  13. T. E. Boult, X. Gao, R. Micheals and M. Eckmann, "Omni-directional visual surveillance," IVC, Vol.22, No.7, pp.515-534, 2004. https://doi.org/10.1016/j.imavis.2003.09.005
  14. S. Morita, K. Yamazawa and N. Yokoya, "Networked video surveillance using multiple omnidirectional cameras," CIRA, 2003.
  15. D. Hall, J. Nascimento, P. Ribeiro, E. Andrade, P. Moreno, S. Pesnel, T. List, R. Emonet, R. B. Fisher, J. Santos Victor and J. L. Crowley, "Comparison of target detection algorithms using adaptive background models," PETS, 2005.
  16. J. Nascimento and J. Marques, "Performance evaluation of object detection algorithms for video surveillance," IEEE Transactions on Multimedia, 2006.
  17. R. Jain and H. Nagel, "On the analysis of accumulative difference pictures from image sequences of real world scenes," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.1, No. 2, pp.206-214, 1979.
  18. A. Elgammal, D. Harwood and L. Davis, "Non-parametric model for background subtraction," European Conference on Computer Vision, pp.751-767, 2000.
  19. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," Computer Vision and Pattern Recognition, pp.246-252, 1999
  20. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/ max-flow algorithms for energy minimization in vision," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.26, No.9, pp.1124- 1137, 2004. https://doi.org/10.1109/TPAMI.2004.60
  21. D. Southwell, A. Basu, M. Fiala, and J. Reyda, "Panoramic stereo," International Conference on Pattern Recognition, 1996.
  22. M. Fiala and A. Basu, "Panoramic stereo reconstruction using non-svp optics," International Conference on Pattern Recognition, 2002
  23. E. L. Cabral, J. C. de Souza Junior and M. C. Hunold, "Omnidirectional stereo vision with a hyperbolic double lobed mirror," International Conference on Pattern Recognition, 2004.
  24. G.-J. Jang, S.-H. Kim and I.-S. Kweon, "Single camera catadioptric stereo system," 5th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras, 2005.
  25. D. Scharstein, R. Szeliski and R. Zabih, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Journal of Computer Vision, Vol.47, pp.7-42, 2002. https://doi.org/10.1023/A:1014573219977
  26. A. S. Ogale and Y. Aloimonos, "A roadmap to the integration of early visual modules," International Journal of Computer Vision, Vol.73. No.1, pp.9-25, 2007
  27. K.-J. Yoon and I.-S. Kweon, "Adaptive support-weight approach for correspondence search," Computer Vision and Pattern Recognition, Vol.28, No.4, pp.650-656, 2006

Cited by

  1. 2D-3D Pose Estimation using Multi-view Object Co-segmentation vol.12, pp.1, 2017, https://doi.org/10.7746/jkros.2017.12.1.033