KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A New Copyright Protection Scheme for Depth Map in 3D Video

  • Li, Zhaotian (Communication & Information Security Lab, Institute of Big Data Technologies Shenzhen Graduate School, Peking University) ;
  • Zhu, Yuesheng (Communication & Information Security Lab, Institute of Big Data Technologies Shenzhen Graduate School, Peking University) ;
  • Luo, Guibo (Communication & Information Security Lab, Institute of Big Data Technologies Shenzhen Graduate School, Peking University) ;
  • Guo, Biao (Communication & Information Security Lab, Institute of Big Data Technologies Shenzhen Graduate School, Peking University)
  • Received : 2016.12.06
  • Accepted : 2017.04.24
  • Published : 2017.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

In 2D-to-3D video conversion process, the virtual left and right view can be generated from 2D video and its corresponding depth map by depth image based rendering (DIBR). The depth map plays an important role in conversion system, so the copyright protection for depth map is necessary. However, the provided virtual views may be distributed illegally and the depth map does not directly expose to viewers. In previous works, the copyright information embedded into the depth map cannot be extracted from virtual views after the DIBR process. In this paper, a new copyright protection scheme for the depth map is proposed, in which the copyright information can be detected from the virtual views even without the depth map. The experimental results have shown that the proposed method has a good robustness against JPEG attacks, filtering and noise.

Keywords

References

  1. Asikuzzaman M, Alam M J, Lambert A J, et al., "A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform," in Proc. of IEEE International Conference on Image Processing. pp. 5497-5501, 2014.
  2. Lin Y H, Wu J L. "A digital blind watermarking for depth-image-based rendering 3D images," IEEE Transactions on Broadcasting, 57(2): 602-611, 2011. https://doi.org/10.1109/TBC.2011.2131470
  3. Kim H D, Lee J W, Oh T W, et al., "Robust DT-CWT watermarking for DIBR 3D images," IEEE Transactions on Broadcasting, 58(4): 533-543, 2012. https://doi.org/10.1109/TBC.2012.2206851
  4. Lee M J, Lee J W, Lee H K., "Perceptual watermarking for 3D stereoscopic video using depth information," in Proc. of International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 81-84, 2011.
  5. Lin Y H, Wu J L. "Unseen visible watermarking for color plus depth map 3D images," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing, pp, 1801-1804, 2012.
  6. Pei S C, Wang Y Y, "Auxiliary Metadata Delivery in View Synthesis Using Depth No Synthesis Error Model," IEEE Transactions on Multimedia, 17(1): 128-133, 2015. https://doi.org/10.1109/TMM.2014.2368255
  7. Guan Y, Zhu Y, Liu X, et al., "A digital blind watermarking scheme based on quantization index modulation in depth map for 3D video," in Proc. of International Conference on Control Automation Robotics & Vision, pp.346-351, 2014.
  8. Liang Zhang, and Wa james Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Transaction on Broadcasting, 51.2, pp.191-199, 2005. https://doi.org/10.1109/TBC.2005.846190
  9. Karsten muller, Philipp merkle, and thomas wiegand, "3D video representation using depth maps," in Proc. of the IEEE, 99(4), pp.643-656, 2011. https://doi.org/10.1109/JPROC.2010.2091090
  10. I. Ahn, and C. Kim, "A novel depth-based virtual view synthesis method for free viewpoint video," IEEE Transaction on Broadcasting, vol. 59, no. 4, pp. 614-626, Dec. 2013. https://doi.org/10.1109/TBC.2013.2281658
  11. Hirschmuller H., "Stereo processing by semiglobal matching and mutual information," IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(2), pp.328-341, 2008. https://doi.org/10.1109/TPAMI.2007.1166
  12. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. "High-quality video view interpolation using a layered representation," ACM Transactions on Graphics, volume 23, pp. 600-608. 2004. https://doi.org/10.1145/1015706.1015766
  13. H. Schwarz, D. Marpe, and T. Wiegand, "Description of exploration experiments in 3d video coding," ISO/IEC JTC1/SC29/WG11 MPEG2010 N, 11274, 2010.
  14. Chen W Y, Chang Y L, Lin S F, et al., "Efficient depth image based rendering with edge dependent depth filter and interpolation," in Proc. of IEEE International Conference on Multimedia and Expo. pp. 1314-1317, 2005.
  15. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on Image Processing, 13(4):600-612, 2004. https://doi.org/10.1109/TIP.2003.819861

Cited by

  1. Feature Analysis and Detection Techniques for Piracy Sites vol.14, pp.5, 2017, https://doi.org/10.3837/tiis.2020.05.019