The Journal of Korean Institute of Communications and Information Sciences (한국통신학회논문지)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient VLSI Architecture of Full-Image Guided Filter Based on Two-Pass Model

양방향 모델을 적용한 Full-image Guided Filter의 효율적인 VLSI 구조

  • Lee, Gyeore (Department of Information, Communication, and Electronic Engineering, The Catholic University of Korea) ;
  • Park, Taegeun (Department of Information, Communication, and Electronic Engineering, The Catholic University of Korea)
  • Received : 2016.09.02
  • Accepted : 2016.11.07
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Full-image guided filter reflects all pixels of image in filtering by using weight propagation and two-pass model, whereas the existing guide filter is processed based on the kernel window. Therefore the computational complexity can be improved while maintaining characteristics of guide filter, such as edge-preserving, smoothing, and so on. In this paper, we propose an efficient VLSI architecture for the full-image guided filter by analyzing the data dependency, the data frequency and the PSNR analysis of the image in order to achieve enough speed for various applications such as stereo vision, real-time systems, etc. In addition, the proposed efficient scheduling enables the realtime process by minimizing the idle period in weight computation. The proposed VLSI architecture shows 214MHz of maximum operating frequency (image size: 384*288, 965 fps) and 76K of gates (internal memory excluded).

Full-image guided filter는 커널 윈도우 영역만 필터링에 반영되는 기존의 커널 윈도우 기반 가이드 필터와 달리 가중치 전파 도식과 양방향 모델이 적용되어 영상의 모든 픽셀이 필터링에 반영된다. 이로써 가이드 필터의 경계 보존과 평활화 등의 가이드 이미지 필터의 특성을 유지하면서도 계산 복잡도를 개선할 수 있다. 본 논문에서는 full-image guided filter의 더 빠른 처리가 필요한 스테레오 비전 및 각종 실시간 시스템 분야에 적용될 수 있도록 효율적인 하드웨어 구조를 제안하였다. 필터링 프로세스에서 발생하는 각종 데이터의 종속성 분석과 영상의 PSNR 분석, 데이터 빈도 분석 등을 통하여 적합한 하드웨어 구조를 제안하였다. 또한 양방향 모델이 적용된 가중치 연산 모듈의 휴식 구간이 최소화되도록 효율적인 스케줄링을 하였고 실시간 처리가 가능하게 하였다. 제안한 하드웨어 구조는 동부하이텍 0.11um 표준셀 라이브러리로 합성하였을 경우 최대 동작주파수 214MHz(384*288 영상: 965 fps)와 76K(내부 메모리 제외) 게이트의 하드웨어 복잡도를 나타냈다.

Keywords

References

  1. K. He, J. Sun, and X. Tang, "Guided image filtering," IEEE Trans. Pattern Anal. and Machine Intell., vol. 35, no. 6, pp. 1397-1409, 2013. https://doi.org/10.1109/TPAMI.2012.213
  2. A. Hosni, M. Bleyer, C. Rhemann, M. Gelautz, and C. Rother, "Real-time local stereo matching using guided image filtering," IEEE Int. Conf. Multimedia and Expo, pp. 1-6, 2011.
  3. J. Wasza, S. Bauer, and J. Hornegger, "Real-time preprocessing for dense 3D range imaging on the GPU: Defect interpolation, bilateral temporal averaging and guided filtering," IEEE Workshop on Consumer Depth Cameras for Computer Vision, pp. 1221-1227, 2011.
  4. Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-preserving decompositions for multiscale tone and detail manipulation," ACM Trans. Graph., vol. 27, no. 3, pp. 67:1-67:10, 2008.
  5. F. Durand and J. Dorsey, "Fast bilateral filtering for the display of high dynamic-range images," ACM Trans. Graph., vol. 21, no. 3, pp. 257-266, 2002.
  6. K. He, C. Rhemann, C. Rother, X. Tang, and J. Sun, "A global sampling method for alpha matting," IEEE Conf. CVPR, pp. 2049-2056, 2011.
  7. A. Chia, S. Zhuo, R. K. Gupta, Y. Tai, S. Cho, P. Tan, and S. Lin, "Semantic colorization with internet images," ACM Trans. Graph., vol. 30, no. 6, pp. 156:1-156:8, 2011.
  8. J. Zhang, L. Li, Y. Zhang, G. Yang, X. Cao, and J. Sun, "Video dehazing with spatial and temporal coherence," Vis. Comput., vol. 27, pp. 749-757, 2011. https://doi.org/10.1007/s00371-011-0569-8
  9. K. He and J. Sun, Fast guided filter, Tech. Report, arXiv:1505.00996v1, 2015.
  10. Q. Yang, D. Li, L. Wang, and M. Zhang, "Full-image guided image filtering for fast stereo matching," IEEE Sign. Process. Lett., vol. 20, no. 3, pp. 237-240, 2013. https://doi.org/10.1109/LSP.2013.2241759
  11. C. Kao, J. Lai, and S. Chien, "VLSI architecture design of guided filter for 30 frames/s full-HD video," IEEE Trans. CAS for Video Technol., vol. 24, No. 3, pp. 513-524, 2014. https://doi.org/10.1109/TCSVT.2013.2278145
  12. Y. Tseng, P. Hsu, and T. Chang, "A 124 Mpixels/s VLSI design for histogram-based joint bilateral filtering," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3231-3241, 2011. https://doi.org/10.1109/TIP.2011.2159226
  13. S. Han, "An architecture for high-throughput and improved-quality stereo vision processor," M.S. Thesis, Dept. Electr. Eng., Univ. of Maryland, College Park, MD, USA, 2010.
  14. K. Hwang, Computer arithmetic: principles, architecture, and design, Wiley, 1979.