Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Depth Map Denoising Based on the Common Distance Transform

공동 거리 변환 기반의 깊이맵 잡음 제거

  • Kim, Sung-Yeol (Gwangju Institute of Science and Technology, School of Information & Communications) ;
  • Kim, Man-Bae (Kangwon National University, IT College, Dept. of Computer & Communications) ;
  • Ho, Yo-Sung (Gwangju Institute of Science and Technology, School of Information & Communications)
  • 김성열 (광주과학기술원 정보통신공학부) ;
  • 김만배 (강원대학교 컴퓨터정보통신공학과) ;
  • 호요성 (광주과학기술원 정보통신공학부)
  • Received : 2012.05.07
  • Accepted : 2012.07.17
  • Published : 2012.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

During depth data acquisition and transmission, the quality of depth maps is usually degraded by physical noise and coding error. In this paper, a new joint bilateral filter based on the common distance transform is presented to enhance the low-quality depth map. The proposed method determines the amount of exploitable color data according to distance transform values of depth and color pixels. Consequently, the proposed filter minimizes noise in the depth map while suppressing visual artifacts of joint bilateral filtering. Experimental results show that our method outperforms other conventional methods in terms of noise reduction and visual artifact suppression.

깊이 정보를 획득하고 전송하는 과정에서 물리적 잡음 및 부호화 손실로 인하여 깊이맵의 품질이 저하된다. 본 논문은 깊이맵 품질을 향상시키기 위해 공동 거리 변환에 기반한 결합 양측 필터(joint bilateral filter)를 제안한다. 제안하는 방법은 깊이맵의 거리 변환값과 색상 영상의 거리 변환값에 따라 잡음 제거에 필요한 색상 정보량을 결정한다. 그 결과 제안하는 필터는 깊이맵 잡음을 효과적으로 제거하면서 결합 양측 필터의 시각적 왜곡 현상을 최소화한다. 컴퓨터 실험을 통해 제안하는 방법이 기존의 방법보다 잡음 제거와 시각적 왜곡 억제 관점에서 성능이 좋아짐을 확인했다.

Keywords

References

  1. C. Fehn, "A 3D-TV system based on video plus depth information," in Proc. of ACSSC, vol. 2, pp. 1529-1533, 2003.
  2. C. Fehn, R. Barre, and S. Pastoor, "Interactive 3-D TV- concepts and key technologies," Proceedings of the IEEE, vol. 94, no. 3, pp. 524-538, 2006. https://doi.org/10.1109/JPROC.2006.870688
  3. S.U. Yoon and Y.S. Ho, "Multiple color and depth video coding using a hierarchical representation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 17, no. 11. pp.1450-1460, 2007. https://doi.org/10.1109/TCSVT.2007.905363
  4. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. of IEEE International Conference on Computer Vision, pp. 839-846, 1998.
  5. M. Elad, "On the origin of the bilateral filter and ways to improve it," IEEE Trans. on Image Processing, vol. 11, no. 10, pp.1141-1150, 2002. https://doi.org/10.1109/TIP.2002.801126
  6. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction", IEEE Trans. on Image Processing, vol. 16, no. 2, pp. 349-366, 2007. https://doi.org/10.1109/TIP.2006.888330
  7. G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K. Toyama, "Digital photography with flash and no-flash image pairs," ACM Trans. on Graphics, vol. 23, no. 3, pp. 664-672, 2004. https://doi.org/10.1145/1015706.1015777
  8. J. Kopf, M.F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM Trans. on Graphics, vol. 26, no. 3, pp.1-6, 2007. https://doi.org/10.1145/1276377.1276379
  9. S.-Y. Kim, J. Cho, A. Koschan, and M. Abidi, "Spatial and temporal enhancement of depth images captured by a time-of-flight depth sensor," in Proc. of IEEE International Conference of Pattern Recognition, pp. 2358-2361, 2010.
  10. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Jour. of Computer Vision, vol. 47, no. 1-3, pp. 7-42, 2002. https://doi.org/10.1023/A:1014573219977
  11. O.P. Gangwal and B. Djapic, "Real-time implementation of depth map post-processing for 3D-TV in dedicated hardware," in Proc. of International Conference of Consumer Electronics, pp. 173-174, 2010.
  12. S.-Y. Kim, W. Cho, A. Koschan, and M. Abidi, "Depth map enhancement using adaptive steering kernel regression based on distance transform," in Proc. of International Symposium and Visual Computing, Lecture Notes in Computer Science, vol. 6938, pp. 291-300, 2011.
  13. G. Borgefors, "Hierarchical chamfer matching: a parametric edge matching algorithm," IEEE Trans. on Patten Analysis and Machine Intelligence, vol. 10, no. 6, pp. 849-865, 1988. https://doi.org/10.1109/34.9107
  14. J. Cho, S.-Y. Kim, Y.S. Ho, and K.H. Lee, "Dynamic 3D human actor generation method using a time-of-flight depth camera," IEEE Trans. on Consumer Electronics, vol. 54, no. 4, pp.1514-1521, 2008. https://doi.org/10.1109/TCE.2008.4711195
  15. J. Canny, "A computational approach to edge detection," IEEE Trans. on Patten Analsys and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986. https://doi.org/10.1109/TPAMI.1986.4767851
  16. S.M. Kim, J. Cha, J. Ryu, and K.H. Lee, "Depth video enhancement for haptic interaction using a smooth surface reconstruction," IEICE Trans. on Information and Systems, vol. E89-D, no. 1, pp. 37-44, 2006. https://doi.org/10.1093/ietisy/e89-d.1.37
  17. ISO/IEC JTC1/SC29/WG11, "Call for proposals on 3D video coding technology," MPEG document N12036, 2011.
  18. ISO/IEC JTC1/SC29/WG11, "Test model under consideration for AVC-based 3D video coding (3DV-ATM)," MPEG document N12349, 2011.

Cited by

  1. Boundary Artifacts Reduction in View Synthesis of 3D Video System vol.21, pp.6, 2016, https://doi.org/10.5909/JBE.2016.21.6.878