Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

High-Performance VLSI Architecture for Stereo Vision

스테레오 비전을 위한 고성능 VLSI 구조

  • Received : 2013.03.07
  • Accepted : 2013.08.14
  • Published : 2013.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposed a new VLSI (Very Large Scale Integrated Circuit) architecture for stereo matching in real time. We minimized the amount of calculation and the number of memory accesses through analyzing calculation of stereo matching. From this, we proposed a new stereo matching calculating cell and a new hardware architecture by expanding it in parallel, which concurrently calculates cost function for all pixels in a search range. After expanding it, we proposed a new hardware architecture to calculate cost function for 2-dimensional region. The implemented hardware can be operated with minimum 250Mhz clock frequence in FPGA (Field Programmable Gate Array) environment, and has the performance of 805fps in case of the search range of 64 pixels and the image size of $640{\times}480$.

본 논문에서는 실시간으로 스테레오 정합을 수행하기 위한 VLSI(Very Large Scale Integrated Circuit)구조를 제안한다. 스테레오 정합의 연산을 분석하여 중간 연산 결과를 재사용하여 연산량과 메모리 접근수를 최소화한다. 이러한 동작을 수행할 수 있는 스테레오 정합 연산 셀의 구조를 제안하고, 이를 병렬적으로 확장하여 탐색 범위 내의 모든 비용함수를 동시에 연산할 수 있는 하드웨어의 구조를 제안한다. 이러한 하드웨어 구조를 확장하여 2차원 영역에 대한 비용함수를 연산할 수 있는 하드웨어의 구조와 동작을 제안한다. 구현한 하드웨어는 FPGA(Field Programmable Gate Array) 환경에서 최소 250Mhz의 클록 주파수에서 동작이 가능하고, 64화소의 탐색범위를 적용한 경우에 $640{\times}480$ 스테레오 영상을 약 805fps의 성능으로 처리할 수 있다.

Keywords

References

  1. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Journal of Computer Vision, Vol. 47, Issue 1-3, pp. 7-42, April 2002. https://doi.org/10.1023/A:1014573219977
  2. M. Z. Brown, D. Burschka, and G. D. Hager, "Advances in computational stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, Issue 8, pp. 993-1008, Aug. 2003. https://doi.org/10.1109/TPAMI.2003.1217603
  3. Y. Wang, J. Ostermann, and Y. Q. Zhang, "Video Processing and Communications," Prentice hall, 2002.
  4. J. Woodfill, B. von Herzen, and R. Zabih, Frame-rate robust stereo on a PCI board. Available: http://www.cs.cornell.edu/rdz/ Papers/Archive /fpga.pdf
  5. J. Sun, N. N. Zheng, and H. Y. Shum, "Stereo matching using belief propagation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, Issue 25, pp. 787-800, July 2003.
  6. S. Kimura, T. Shinbo, H. Yamaguchi, E. Kawamura, and K. Nakano, ""A convolver-based real-time stereo machine (SAZAN),"" in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Fort Collins, CO, vol. 1, pp. 457-463, Jun. 1999.
  7. M. Kuhn, S. Moser, O. Isler, F. K. Gurkaynak, A. Burg, N. Felber, H. Kaeslin, and W. Fichtner, ""Efficient ASIC implementation of a real- time depth mapping stereo vision system,"" in Proc. IEEE Int. Circuits Syst. (MWSCAS '03), Cairo, Egypt, vol. 3, pp. 1478-1481, Dec. 2003.
  8. A. Darabiha, J. Rose, and W. J. Maclean, "ideo-rate stereo depth measurement on programmable hardware,"in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Madison, WI, vol. 1, pp. 203 -210, Jun. 2003.
  9. Y. Jia, X. Zhang, M. Li, and L. An, "A miniature stereo vision machine (MSVM-III) for dense disparity mapping," in Proc. 17th Int. Conf. Pattern Recognit., Cambridge, U.K., vol. 1. pp. 728-731, Aug. 2004
  10. J. I. Woodfill, G. Gordon, and R. Buck, ""Tyzx DeepSea high speed stereo vision system,"" in Proc. IEEE Comput. Soc. Workshop Real-Time 3-D Sensors Use Conf. Comput. Vision Pattern Recog., Washington D.C., Jun. 2004, pp. 41-46.
  11. S. Jin, J. Cho, X. D. Pham, K. M. Lee, S.-K. Park, M. Kim, and J. W. Jeon,, "FPGA Design and Implementation of a Real-Time Stereo Vision System," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 20, No. 1, pp. 15-26, Jan. 2010. https://doi.org/10.1109/TCSVT.2009.2026831
  12. R. C. Gonzales and R. E. Woods, "Digital image processing," Prentice Hall, 2nd edtion, 2001.