Journal of the Institute of Electronics and Information Engineers (전자공학회논문지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

DSP Optimization for Rain Detection and Removal Algorithm

비 검출 및 제거 알고리즘의 DSP 최적화

  • Received : 2014.07.14
  • Accepted : 2015.09.03
  • Published : 2015.09.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a DSP optimization solution of rain detection and removal algorithm. We propose rain detection and removal algorithms considering camera motion, and also presents optimization results in algorithm level and DSP level. At algorithm level, this paper utilizes a block level binary pattern analysis, and reduces the operation time by using the fast motion estimation algorithm. Also, the algorithm is optimized at DSP level through inter memory optimization, EDMA, and software pipelining for real-time operation. Experiment results show that the proposed algorithm is superior to the other algorithms in terms of visual quality as well as processing speed.

본 논문은 비 검출 및 제거 알고리즘의 DSP 최적화 기법을 제안한다. 우리는 카메라 움직임이 있는 환경에서 비 검출 및 제거 기법을 제안하고, 알고리즘 레벨 및 DSP 레벨에서 최적화를 수행한다. 제안하는 기법은 알고리즘 측면에서 기존에 활용하던 라벨링을 블록 단위의 이진 패턴 분석을 통해 오 검출 영역을 제거하는 방식으로 대체하였고 고속 움직임 추정 알고리즘을 이용하여 연산 시간을 개선하였다. DSP 측면에서는 내부 메모리 최적화와 EMDA이용, 소프트웨어 파이프라인 등을 통한 최적화를 통해 임베디드 환경에서 실시간성을 보이며 실험 결과에서는 제안 기법의 성능과 시간 측면의 우수성을 보여준다.

Keywords

References

  1. K. Garg and S. K. Nayar, "Detection and removal of rain from videos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2004, vol. 1, pp. 528-535.
  2. X. Zhang, H. Li, Y. Qi, W. K. Leow, and T. K. Ng, "Rain removal in video by combining temporal and chromatic properties," in Proc. IEEE Int. Conf. Multimedia Expo., Toronto, ON, Canada, Jul. 2006, pp. 461-464.
  3. P. Barnum, T. Kanade, and S. G. Narasimhan, "Spatio-temporal frequency analysis for removing rain and snow from videos," in Workshop on Photometric Analysis for Computer Vision, in Conjunction with International Conference on Computer Vision, 2007.
  4. P. Barnum, S. Narasimhan, and T. Kanade, "Analysis of rain and snow in frequency space," Int. J. Comput. Vis., vol. 86, no. 2/3, pp. 256-274, Jan. 2010. https://doi.org/10.1007/s11263-008-0200-2
  5. X. Xue, X. Jin, C. Zhang, and S. Goto, "Motion robust rain detection and removal from videos," in Proc, IEEE Int. Workshop on Multimedia Signal Processing, 2012, pp.170-174.
  6. J. H. Kim, C. Lee, J. Y. Sim and C. S. Kim, "Single-image deraining using an adaptive nonlocal means filter," in Proc. IEEE Conf. Image Process., Sept. 2013, pp.914-917.
  7. H. G. Kim, S. J. Seo, and B. C. Song, "Multi-frame de-raining algorithm using a motion-compensated non-local mean filter for rainy video sequences," J. Visual Commun. Image Represent., Jan. 2015, vol. 26, pp. 317-328. https://doi.org/10.1016/j.jvcir.2014.10.006
  8. J. H. Lee, K. W. Lim, B. C. Song, and J. B. Ra, "A fast multi-resolution block matching algorithm and its LSI architecture for low bit-rate video coding," IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 12, pp.1289-1300, Dec. 2001. https://doi.org/10.1109/76.974683
  9. A. M. Tourapis, O. C. Au, and M. L. Liou, "Highly efficient predictive zonal algorithms for fast block-matching motion estimation," IEEE Trans. Circuits and Systems for Video Technology, vol. 12, no. 10, pp. 934-941, Oct. 2002. https://doi.org/10.1109/TCSVT.2002.804894
  10. K. He, J. Sun, and X. Tang, "Guided image filtering," in Proc. European Conf. Computer Vision, pp. 1-14, 2010.
  11. J. P. Tarel and N. Hautiere, "Fast visibility restoration from a single color or gray level image," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 2201-2208.