Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Visibility Enhancement of Underwater Stereo Images Using Depth Image

깊이 영상을 이용한 수중 스테레오 영상의 가시성 개선

  • Shin, Hyoung-Chul (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kim, Sang-Hoon (Department of Broadcasting and Video, Cheju Halla College) ;
  • Sohn, Kwang-Hoon (School of Electrical and Electronic Engineering, Yonsei University)
  • 신형철 (연세대학교 전기전자공학부) ;
  • 김상훈 (제주한라대학교 방송영상과) ;
  • 손광훈 (연세대학교 전기전자공학부)
  • Received : 2012.05.22
  • Accepted : 2012.06.19
  • Published : 2012.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the underwater environment, light is absorbed and scattered by water and floating particles, which makes the underwater images suffer from color degradation and limited visibility. Physically, the amount of the scattered light transmitted to the image is proportional to the distance between the camera and the object. In this paper, the proposed visibility enhancement. method utilizes depth images to estimate the light transmission and the degradation factor by the scattered light. To recover the scatter-free images without unnatural artifacts, the proposed method normalizes the degradation factor based on the value of each pixel of the image. Finally, the scatter-free images are obtained by removing the scattered components on the image according to the estimated transmission. The proposed method also considers the color discrepancies of underwater stereo images so that the stereo images have the same color appearance after the visibility enhancement. The experimental results show that the proposed method improves the color contrast more than 5% to 14% depending on the experimental images.

수중 환경에서 물과 부유물에 의한 빛의 감쇄와 산란은 수중 영상의 색상을 열화시키고 가시성을 저하시키는 주요 원인이 된다. 이러한 수중 산란광은 피사체와의 거리의 함수로 표현되므로 깊이 정보는 빛의 전달률을 계산하기 위한 중요한 정보를 제공한다. 본 논문에서는 깊이 영상을 이용하여 전달률을 측정하고 이를 기반으로 영상의 각 화소에 존재하는 산란에 의한 열화값을 제거함으로써 수중 스테레오 영상의 가시성을 개선하는 방법을 제안한다. 제안하는 방법은 제거해야 하는 열화값이 영상의 화소값 보다 크지 않도록 보정하여 가사성 개선 시 나타날 수 있는 부분적인 영상 왜곡을 방지한다. 또한 수중 스테레오 영상의 심각한 문제점 중의 하나인 색상 불균형을 효과적으로 보정하여 가시성 개선 후 좌, 우 영상의 동일성을 유지한다. 실험 결과는 다양한 환경의 수중 영상에 대하여 제안하는 가시성 개선 후 색대비가 영상에 따라 5%에서 14%이상 향상되었음을 보여준다.

Keywords

References

  1. F. Kooi and A. Toet, "Visual comfort of binocular and 3D displays," Display vol 25, pp. 99-108, 2004. https://doi.org/10.1016/j.displa.2004.07.004
  2. F. Speranza, W. Tam, R. Renaud, and N. Hur, "Effect of disparity and motion on visual comfort of stereoscopic images," in Proc. of SPIE. vol. 6055, pp. 94-103, 2006.
  3. Y. Y. Schechner and N. Karpel, "Recovery of underwater visibility and structure by polarization analysis," IEEE Journal of Oceanic Engineering, vol. 30, no. 3, pp. 570-587, 2005. https://doi.org/10.1109/JOE.2005.850871
  4. T. Treibitz and Y. Y. Schechner, "Active polarization descattering," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 385-399, 2009. https://doi.org/10.1109/TPAMI.2008.85
  5. S. Bazeille, I. Quidu, L. Jaulin, and J. P. Malkasse, "Automatic underwater image pre-processing," in Proc. of the Caracterisation du Milieu Marin (CMM '06), 2006.
  6. J. Queiroz-Neto, R. Carceroni, W. Barros, and M. Campos, "Underwater stereo," in Brazilian Symp. Comp. Graphics Image Processing, pp. 170-177, 2004.
  7. K. He, J. Sun, and X.Tang, "Single image haze removal using dark channel prior," in Proc. of CVPR '09 , pp. 1956-1963, 2009.
  8. C. Liu and M. Wang, "Removal of water scattering," In Proc. of IEEE International Conference on Computer Engineering and Technology(ICCET'10), vol. 2, pp. 35-39 ,2010.
  9. J. S. Jaffe, "Computer modeling and the design of optimal underwater imaging systems," IEEE Journal of Oceanic Engineering, vol. 15, no. 2, pp. 101-111, 1990. https://doi.org/10.1109/48.50695
  10. S. G. Narasimhan and S. K. Nayar, "Vision and the atmosphere. Int. J. Computer Vision," vol. 48 no. 3, pp. 233-254, 2002. https://doi.org/10.1023/A:1016328200723
  11. F. A. Jenkins and H. E. White, "Fundamentals of optics. McGraw-Hill," 1997.
  12. H. Shin, U. Yang and K. Sohn, "Local Color Correction with 3D Point Set Registration for Underwater Stereo Images," Optical Engineering, vol. 51, no. 4, Apr. 2012.
  13. B. Ham, D. Min and K. Sohn, "Cost Aggregation with Anisotropic Diffusion in Feature space for Hybrid Stereo Matching," in Proc. IEEE ICIP 2011, September 2011.
  14. A. Levin, D. Lischinski, and Y. Weiss, "A closed form solution to natural image matting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 228-242, 2008. https://doi.org/10.1109/TPAMI.2007.1177