JSTS:Journal of Semiconductor Technology and Science

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient Hardware Implementation of Real-time Rectification using Adaptively Compressed LUT

  • Kim, Jong-hak (Sungkyunkwan University, Department of IT convergence) ;
  • Kim, Jae-gon (Sungkyunkwan University, Department of IT convergence) ;
  • Oh, Jung-kyun (Sungkyunkwan University, Department of IT convergence) ;
  • Kang, Seong-muk (Sungkyunkwan University, Department of IT convergence) ;
  • Cho, Jun-Dong (Sungkyunkwan University, Department of IT convergence)
  • Received : 2015.06.17
  • Accepted : 2015.12.25
  • Published : 2016.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Rectification is used as a preprocessing to reduce the computation complexity of disparity estimation. However, rectification also requires a complex computation. To minimize the computing complexity, rectification using a lookup-table (R-LUT) has been introduced. However, since, the R-LUT consumes large amount of memory, rectification with compressed LUT (R-CLUT) has been introduced. However, the more we reduce the memory consumption, the more we need decoding overhead. Therefore, we need to attain an acceptable trade-off between the size of LUT and decoding overhead. In this paper, we present such a trade-off by adaptively combining simple coding methods, such as differential coding, modified run-length coding (MRLE), and Huffman coding. Differential coding is applied to transform coordinate data into a differential form in order to further improve the coding efficiency along with Huffman coding for better stability and MRLE for better performance. Our experimental results verified that our coding scheme yields high performance with maintaining robustness. Our method showed about ranging from 1 % to 16 % lower average inverse of compression ratio than the existing methods. Moreover, we maintained low latency with tolerable hardware overhead for real-time implementation.

Keywords

References

  1. Heiko Hubert, Benno Stabernack, and Frederik Zilly, "Architecture of a Low Latency Image Rectification Engine for Stereoscopic 3-D HDTV Processing," IEEE Trans. on Circuits and Systems for Video Technology, Vol. 23, No. 5, pp. 813-822, May 2013. https://doi.org/10.1109/TCSVT.2012.2223795
  2. Ayman F. Habib, Eui-Myoung Kim and Chang-Jae Kim, "New Methodologies for True Orthophoto Generation," Photogrammetric Engineering & Remote Sensing, Vol. 73, No. 1, pp. 25-36, Jan, 2007. https://doi.org/10.14358/PERS.73.1.25
  3. Tie Hu, Peter K. Allen, Tejas Nadkarni, Nancy J. Hogle and Dennis L. Fowler, "Insertable Stereoscopic 3D Surgical Imaging Device with Pan and Tilt," 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics(BioRob) Arizona, pp. 311-316, 2008.
  4. Kyoungwon Nam, Jeongyun Park, Inyoung Kim, and Kwanggi Kim, "Application of stereo-imaging technology to medical field," Healthcare informatics research, 18(3), pp. 158-163, 2012. https://doi.org/10.4258/hir.2012.18.3.158
  5. Yu-Chih Liu, Kai-Ying Lin, and Yong-Sheng Chen. "Bird's-eye view vision system for vehicle surrounding monitoring," Robot vision, Springer Berlin Heidelberg, pp. 207-218, 2008.
  6. Yu-Lung Chang, Li-You Hsu, and Oscal T. -C. Chen, "Auto-Calibration Around-View Monitoring System," Vehicular Technology Conference (VTC Fall), 2013 IEEE 78th, IEEE, 2013.
  7. Anwar Hasni Abu Hasan, Rostam Affendi Hamzah, and Mohd Haffiz Johar, "Range Estimation in Disparity Mapping for Navigation of Stereo Vision Autonomous Vehicle using Curve Fitting Tool," International Journal of Video & Image Processing and Network Security IJVIPNS, Vol. 9, No. 9, pp. 101-105, 2009.
  8. Wannes van der Mark, and Dariu M. Gavrila, "Real-time Dense Stereo for Intelligent vehicles," IEEE Trans. on Intelligent Transportation System, Vol. 7, No. 1, pp. 38-50, 2006. https://doi.org/10.1109/TITS.2006.869625
  9. Marc Pollefeys, Reinhard Koch, and Luc Van Gool, "A Simple and Efficient Rectification method for General Motion," in Proc. Computer vision, vol. 1, pp 496-501, Sep, 1999.
  10. Yun-Suk Kang, Cheon Lee, and Yo-Sung Ho. "An Efficient Rectification Algorithm for Multi-view Images in Parallel Camera Array," 3DTV conference: The True Vision-Capture, Transmission and Display of 3D Video 2008 IEEE, 2008.
  11. Yunseok Lee, Kar-Ann Toh and Sangyoun Lee, "Stereo Image Rectification based on Polar Transformation," Optical Engineering, 47(8), 087205, Aug, 2008. https://doi.org/10.1117/1.2969124
  12. Andrea Fusiello, Emanuele Trucco and Alessandro Verri, "A Compact Algorithm for Rectification of Stereo pairs," Machine Vision and Applications, Vol. 12, pp. 16-22, 2000. https://doi.org/10.1007/s001380050120
  13. Anders Kjaer-Nielsen, Lars Baunegaard with Jensen, Anders Stengaard Sorensen, and Norbert Kruger, "A Real-time Embedded System for Stereo Vision Preprocessing using an FPGA," in Proc. Reconfigurable Computing and FPGAs, pp. 37-42, Dec, 2008.
  14. S. Jin, J. Cho, X. D. Pham, K. M. Lee, S. K. Park, M. Kim and J. W. Jeon, "FPGA Design and Implementation of a Real-time Stereo Vision System," IEEE Trans. on Circuits and Systems for Video technology, Vol. 20, No. 1, pp. 15-26, Jan, 2010. https://doi.org/10.1109/TCSVT.2009.2026831
  15. Dongil Han, Jeahoon Choi, and Hochul Shin , "A Real-time Hardware Architecture for Image Rectification using Floating Point Processing," Journal of the Institute of Electronics and Information Engineers, pp. 102-113, Feb, 2014.
  16. Deuk Hyun Park, Hyoung Seok Ko, Jae Gon Kim and Jun Dong Cho, "Real Time Rectification using Differentially Encoded Lookup Table," in Proc. ICUIMC 2011, No. 47, Feb, 2011.
  17. Jong-hak Kim, Jung-kyun Oh, Seong-muk Kang, and Jun-dong Cho, "A Real-time Rectification using an Adaptive Differential Encoding for Highresolution Video," in Proc. ICACT 2014, pp. 666- 670, 2014.
  18. Abdulkadir Akin, Ipek Baz, Luis Manuel Gaemperle, Alexandre Schmid and Yusuf Leblebici, "Compressed Look-Up-Table based Real-Time Rectification Hardware," in Proc. VLSI-SoC 2013, pp. 272-277, Oct, 2013.
  19. Faugeras O, "Three-Dimensional Computer Vision: A Geometric Viewpoint," The MIT press, Cambridge, MASS, 1933.
  20. David A. Huffman, "A Method for the Construction of Minimum-Redundancy Codes," in Proc. The I.R.E., pp. 1098-1101, Sep, 1952.
  21. Charles Ponyton, "Digital video and HD: algorithms and interfaces," Morgan Kaufmann Publishers.
  22. Cristian Vancea, and Sergiu Nedevschi, "LUT-based Image Rectification Module Implemented in FPGA," in Proc. ICCP, pp. 147-154, Sep, 2007.
  23. Hyeon-sik Son, Kyeong-ryeol Bae, Seung-ho Ok, Yong-hwan Lee, and Byung-in Moon, "A Rectification Hardware Architecture for an Adaptive Multiple-Baseline Stereo Vision System," Communications in Computer and information Science, Vol. 265, pp. 147-155, 2012.
  24. Hejian Li, Ping An, and Zhaoyang Zhang, "Full high-definition real-time depth estimation for threedimensional video system," Optical Engineering, 53(9), 093108, Sep, 2014. https://doi.org/10.1117/1.OE.53.9.093108
  25. Wenqiang Wang, Jing Yan, Ningyi Xu, Yu Wang, and Feng-Hsiung Hsu, "Real-time High-quality Stereo Vision System in FPGA," IEEE Trans. on Circuits and system for video technology, Vol. PP, Jan, 2015.

Cited by

  1. Image Cache for FPGA-based Real-time Image Warping vol.53, pp.6, 2016, https://doi.org/10.5573/ieie.2016.53.6.091