Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Real-time Gaussian Hole-Filling Algorithm using Reverse-Depth Image

반전된 Depth 영상을 이용한 실시간 Gaussian Hole-Filling Algorithm

  • Received : 2012.04.10
  • Accepted : 2012.05.29
  • Published : 2012.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Existing method of creating Stereoscopy image, creates viewpoint image from the left and right by shooting one object with 2 lens in certain distance. However, in case of 3-D TV using Stereoscopy camera, the necessity to transmit 2 viewpoint images from the left and right simultaneously, increases the amount of bandwidth. Various and more effective alternatives are under discussion. Among the alternatives, DIBR(Depth Image Based Rendering) creates viewpoint images from the left and right using one image and its Depth information, thus decreasing the amount of transmitted bandwidth. For this reason, there have been various studies on Algorithm to create DIBR Image in existing Static Scene. In this paper, I would like to suggest Gaussian Hole-filling solution, which utilizes reverse-depth image to fill the hole naturally, while minimizing distortion of background. In addition, we have analyzed the effectiveness of each Algorithm by comparing and calculating its functions.

기존의 Stereoscopy영상의 생성 방법은 2개의 촬영용 렌즈를 일정한 간격으로 띄워놓고 같은 피사체를 촬영하여 좌우 시점의 영상을 생성하는 방법을 이용하게 된다. 하지만 Stereoscopy 카메라를 이용한 3차원 TV 수신의 경우에 좌시점과 우시점에 대한 2개의 영상을 모두 동시에 전송해야 하기 때문에 대역폭의 부담이 크다. 이에 보다 효율적인 여러 방법들에 대한 논의가 이루어지고 있다. 그중 DIBR(Depth Image Based Rendering)은 한장의 영상과 이에 대한 Depth정보를 이용하여 좌시점과 우시점의 영상을 생성하기 때문에 전송 대역폭을 줄일 수 있으며, 이러한 점으로 인하여 기존의 Static Scene에서 DIBR Image 생성에 대한 다양한 Algorithm이 연구되어 왔다. 본 논문에서는 반전된 Depth 영상을 이용하여 자연스럽게 Hole을 채움과 동시에 주변 배경의 왜곡 또한 최소화하는 Gaussian Hole-Filling 방법을 제안하려 한다. 또한 각 Algorithm들의 성능을 비교, 계산하여 각 Algorithm들의 효용성을 분석하였다.

Keywords

References

  1. C. Fehn, R. Barre, and R. S. Pastoor, "Interactive 3-DTV concepts and key technologies," Proc. of the IEEE, vol. 94, no. 3, pp. 524-38, Mar. 2006. https://doi.org/10.1109/JPROC.2006.870688
  2. C. Fehn, E. Cooke, O. Schreer, and P. Kauff, "3D Analysis and Image-Based Rendering for Immersive TV Applications," Signal Processing: Image Communication 17, pp. 705-15, Oct. 2002. https://doi.org/10.1016/S0923-5965(02)00079-6
  3. J. Flack, P. Harman, S. Fox, "Low bandwidth stereoscopic image encoding and transmission", Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems X, Vol. 5006, pp. 206-214, CA, U.S.A., Jan. 2003.
  4. C. Fehn, "Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV", Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, Vol. 5291, pp. 93-104, CA, U.S.A., Jan. 2004.
  5. Wan-Yu Chen, Yu-Lin Chang, Shyh-Feng Lin, Li-Fu Ding, and Liang-Gee Chen, "Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation."Multimedia and Expo, ICME 2005, pp. 1314- 1317，July 2005,
  6. Wan-Yu Chen, Yu-Lin Chang, Shyh-Feng Lin, Li-Fu Ding, and Liang-Gee Chen, "Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation."Multimedia and Expo, ICME 2005, pp. 1314- 1317，July 2005,
  7. A. Smolic, K. Muller, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, "Intermediate view interpolation based on multi-viewvideo plus depth for advanced 3D video systems," Proc. of ICIP, pp. 2448-451, 2008.
  8. C. Fehn, "A 3D-TV approach using depth-imagebased rendering (DIBR)", Proceedings of VIIP 03, Benalmadena, Spain, Sept. 2003.
  9. L. Zhang and W. Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191--99, June 2005. https://doi.org/10.1109/TBC.2005.846190
  10. Wan-Yu Chen, Yu-Lin Chang, Hsu-Kuang Chiu, Shao-Yi Chien, and Liang-Gee Chen 'Real-Time Depth Image based Rendering Hardware Accelerator for Advanced Three Dimensional Television System', Proc. of the ICME IEEE, pp. 2069-2072, 9-12 July 2006
  11. W. J. Tam, G. Alain, L. Zhang, T. Martin, R. Renaud, "Smoothing depth maps for improved stereoscopic image quality", Proceedings of SPIE Conference on Three-dimensional TV, Video, and Display III, Vol. 5599, pp.162-172, Philadelphia, U.S.A., Oct. 2004.
  12. A. Woods, T. Docherty, R. Koch, "Image distortions in stereoscopic video systems", Proceedings of SPIE Conference on Stereoscopic Displays and Applications, pp. 36-48, San Jose, CA, USA, Feb. 1993.
  13. W. J. Tam, L. Zhang, "Non-uniform smoothing of depth maps before image-based rendering". Proceedings of SPIE Conference on Three-dimensional TV, Video, and Display III, Vol. 5599, pp.173-183, Philadelphia, U.S.A., Oct. 2004.
  14. ITU: 'Objective perceptual video quality measurement techniques for digital cable', ITU-T Recommendation J.144, Geneva, Switzerland, March 2003

Cited by

  1. Parallax Map Preprocessing Algorithm for Performance Improvement of Hole-Filling vol.13, pp.10, 2013, https://doi.org/10.5392/JKCA.2013.13.10.062