DOI QR코드

DOI QR Code

Pattern-based Depth Map Generation for Low-complexity 2D-to-3D Video Conversion

저복잡도 2D-to-3D 비디오 변환을 위한 패턴기반의 깊이 생성 알고리즘

  • Received : 2014.10.13
  • Accepted : 2015.02.09
  • Published : 2015.02.28

Abstract

2D-to-3D video conversion vests 3D effects in a 2D video by generating stereoscopic views using depth cues inherent in the 2D video. This technology would be a good solution to resolve the problem of 3D content shortage during the transition period to the full ripe 3D video era. In this paper, a low-complexity depth generation method for 2D-to-3D video conversion is presented. For temporal consistency in global depth, a pattern-based depth generation method is newly introduced. A low-complexity refinement algorithm for local depth is also provided to improve 3D perception in object regions. Experimental results show that the proposed method outperforms conventional methods in terms of complexity and subjective quality.

2D-to-3D 비디오 변환 기술은 2D 비디오 속에 내재하는 깊이 단서를 이용하여 스테레오 영상을 생성함으로써 2D 비디오에 3D 효과를 부여한다. 이 기술은 완전한 3D 비디오 시대로 가는 과도 기간 동안 3D 콘텐츠의 부족문제를 해결할 수 있는 유용한 기술이다. 본 논문은 2D-to-3D 비디오 변환의 저 복잡도 구현을 위한 새로운 깊이 생성 방안을 제시한다. 제안 기법에서는 전역 깊이의 시방향 일관성을 위하여 패턴 기반의 전역 깊이 생성 기법을 제안하였다. 뿐만 아니라 객체 영역의 3D 입체감 개선을 위한 저 복잡도의 객체 깊이 개선 알고리즘도 추가적으로 제시하였다. 실험을 통해 제안 알고리즘이 복잡도와 주관적 화질 측면에서 기존 방식들에 비해 우수한 성능을 나타냄을 보인다.

Keywords

References

  1. L. Zhang, C. Vazquez, and S. Knorr, "3DTV content creation: automatic 2D-to-3D video conversion," IEEE Trans. Broadcast., Vol.57, No.2, pp.372-383, 2011(6). https://doi.org/10.1109/TBC.2011.2122930
  2. Y. Matsumoto, H. Terasaki, K. Sugimoto, and T. Arakawa, "Conversion system of monocular image conversion technologies," In Proc. of SPIE Photonic West, Vol.3012, pp.108-112, 1997(2).
  3. T. Okino, G. Murata, K. Taima, T. Iinuma, and K. Oketani, "New television with 2D/3D image conversion techniques," In Proc. of SPIE Photonic West, Vol.2653, pp.96-100, 1996(1).
  4. M. T. Pourazad, P. Nasiopoulos, and R. K. Ward, "An H.264-based scheme for 2D to 3D video conversion," IEEE Trans. Consumer Electron, Vol.55, No.2, pp.742-748, 2009(5). https://doi.org/10.1109/TCE.2009.5174448
  5. D. Kim, D. Min, and K. Sohn, "A stereoscopic video generation method using stereoscopic display characterization and motion analysis," IEEE Trans. Broadcast, Vol.54, No.2, pp.188-197, 2008(6). https://doi.org/10.1109/TBC.2007.914714
  6. Z. Li, X. Cao, and Q. H. Dai, "A novel method for 2D-to-3D video conversion using bi-directional motion estimation," In Proc. of 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1429-1432, 2012(3).
  7. W. J. Tam, A. S. Yee, J. Ferreira, S. Tariq, and F. Speranza, "Stereoscopic image rendering based on depth maps created from blur and edge information," In Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XII, Vol.5664, pp.104-115, 2005(1).
  8. C. C. Cheng, C. T. Li, and L. G. Chen, "A 2D-to-3D Conversion System Using Edge Information," In Proc. of IEEE International Conference on Consumer Electronics(ICCE), pp.377-378, 2010(1).
  9. Y. L. Chang, Y. P. Tsai, T. H. Chang, Y. R. Chen, and S. Lei, "A depth map refinement algorithm for 2D-to-3D conversion," In Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1437-1440, 2012(3).
  10. L. Vosters and G. de Haan, "Efficient and Stable Sparse to Dense Conversion for Automatic 2D-to-3D Conversion," IEEE Trans. Circuits Syst. Video Technol., Vol.23, No.3, pp.373-386, 2013(3). https://doi.org/10.1109/TCSVT.2012.2203747
  11. S. Battiatoa, S. Curtib, M. L, Casciac, M. Tortorac, and E. Scordato, "Depth Map Generation by Image Classification," In Proc. of SPIE Electronic Imaging, Vol.5302, pp.95-104, 2004(1).
  12. S. Battiato, A. Capra, S. Curti, and M. La Cascia, "3D stereoscopic image pairs by depth-map generation," In Proc. of Second International Symposium on 3D Date Processing, Visualization and Transmission, pp.124-131, 2004(9).
  13. P. Ji, L. Wang, D. X. Li, and M. Zhang, "A novel 2D-to-3D conversion method based on blocks world," In Proc. of 2012 International Conference on Audio, Language and Image Processing (ICALIP), pp.541-545, 2012(6).
  14. X. Huang, L. Wang, J. Huang, D. Li, and M. Zhang, "A depth extraction method based on motion and geometry for 2D to 3D conversion," In Proc. of Third International Symposium on Intelligent Information Technology Application, Vol.3, pp.294-298, 2009(11).
  15. Y. L. Chang, J. Y. Chang, Y. M. Tsai, C. L. Lee, and L. G. Chen, "Priority depth fusion for the 2D-to-3D conversion system," In Proc. of SPIE Electronics Imaging, Vol.6805, pp.1-8, 2008(2).
  16. S. F. Tsai, C. C. Cheng, C. T. Li, and L. G. Chen, "A real-time 1080p 2D-to-3D video conversion system," IEEE Trans. Consumer Electron, Vol.52, No.2, pp.915-922, 2011(5).
  17. P. Ji, L. Wang, D. X. Li, and M. Zhang, "An automatic 2D to 3D conversion algorithm using multi-depth cues," In Proc. of 2012 International Conference on Audio, Language and Image Processing (ICALIP), pp.546-550, 2012(7).
  18. Y. K. Lai, Y. F. Lai, and Y. C. Chen, "An Effective Hybrid Depth-Generation Algorithm for 2D-to-3D Conversion in 3D Displays," Journal of Display Technology, Vol.9, No.3, pp.154-161, 2013(5). https://doi.org/10.1109/JDT.2012.2224637
  19. 한찬희, 최해철, 이시웅, "2차원 동영상의 3차원 변환을 위한 깊이 단서의 신뢰성 기반 적응적 깊이 융합", 한국콘텐츠학회논문지, 제12권, 제12호, pp.1-13, 2012. https://doi.org/10.5392/JKCA.2012.12.12.001