KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Transformations and Their Analysis from a RGBD Image to Elemental Image Array for 3D Integral Imaging and Coding

  • Yoo, Hoon (Dept. Electronics, SangMyung University)
  • Received : 2017.07.23
  • Accepted : 2018.01.18
  • Published : 2018.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper describes transformations between elemental image arrays and a RGBD image for three-dimensional integral imaging and transmitting systems. Two transformations are introduced and analyzed in the proposed method. Normally, a RGBD image is utilized in efficient 3D data transmission although 3D imaging and display is restricted. Thus, a pixel-to-pixel mapping is required to obtain an elemental image array from a RGBD image. However, transformations and their analysis have little attention in computational integral imaging and transmission. Thus, in this paper, we introduce two different mapping methods that are called as the forward and backward mapping methods. Also, two mappings are analyzed and compared in terms of complexity and visual quality. In addition, a special condition, named as the hole-free condition in this paper, is proposed to understand the methods analytically. To verify our analysis, we carry out experiments for test images and the results indicate that the proposed methods and their analysis work in terms of the computational cost and visual quality.

Keywords

References

  1. G. Lippmann, "La photographic intergrale," Computes-Rendus. Acad. Sci, vol. 146, pp. 446-451, 1908.
  2. Y. Igarashi, H. Murata, and M. Ueda, "3D display system using a computer generated integral photography," Jpn. J. Appl. Phys., vol. 17, no. 9, pp. 1683-1684, Jan. 1978. https://doi.org/10.1143/JJAP.17.1683
  3. N. Dodgson, "Autostereoscopic 3D displays," IEEE Computer, vol. 38, no. 8, pp. 31-36, 2005. https://doi.org/10.1109/MC.2005.252
  4. N. S. Holliman, N. A. Dodgson, G. E. Favalora, and L. Pockett, "Three-dimensional displays: a review and applications analysis," IEEE Trans. Broad., vol. 57, no. 2, pp. 362-371, Jun. 2011. https://doi.org/10.1109/TBC.2011.2130930
  5. A. Stern and B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE, vol. 94, no. 3, pp. 591-607, Mar. 2006. https://doi.org/10.1109/JPROC.2006.870696
  6. S. Park, J. Yeom, Y. Jeong, N. Chen, J.-Y. Hong, and B. Lee, "Recent issues on integral imaging and its applications," Journal of Information Display, vol. 15, no. 1, pp.37-46, 2014. https://doi.org/10.1080/15980316.2013.867906
  7. J.-S. Jang and B. Javidi, "Three-dimensional synthetic aperture integral imaging," Optics Letters, vol. 27, no. 13, pp. 1144-1146, Jul. 2002. https://doi.org/10.1364/OL.27.001144
  8. H. Yoo, "Artifact analysis and image enhancement in three dimensional computational integral imaging using smooth windowing technique," OSA Optics Letters, vol. 36, no. 12, pp. 2107-2109 Jun. 2011. https://doi.org/10.1364/OL.36.002107
  9. H. Yoo, "Depth extraction for 3D objects via windowing technique in computational integral imaging with a lenslet array," Elsevier Optics and Lasers in Engineering, vol. 51, no. 7, pp. 912-915, Jul. 2013. https://doi.org/10.1016/j.optlaseng.2013.02.009
  10. H. Yoo, D.-H. Shin, and M. Cho, "Improved depth extraction method of 3D objects using computational integral imaging reconstruction based on multiple windowing techniques," Elsevier Optics and Lasers in Engineering, vol. 66, no. 3, pp. 105-111, Mar. 2015. https://doi.org/10.1016/j.optlaseng.2014.08.015
  11. Y. Lee and H. Yoo, "Three-dimensional visualization of objects in scattering medium using integral imaging and spectral analysis," Elsevier Optics and Lasers in Engineering, vol. 77, no. 2, pp. 31-38, Feb. 2016. https://doi.org/10.1016/j.optlaseng.2015.07.007
  12. Y. Piao, H. Qua, M. Zhang, and M. Cho, "Three-dimensional integral imaging display system via off-axially distributed image sensing," Optics and Lasers in Engineering, vol. 85, pp. 18-23, Oct. 2016. https://doi.org/10.1016/j.optlaseng.2016.03.023
  13. C. Fehn, "A 3D-TV system based on video plus depth information," in Proc. of 37th Asilomar Conf. on IEEE Signals, Systems and Computers, vol. 2, pp. 1529-1533, Nov. 2003.
  14. C. Fehn, "A 3D-TV approach using depth-image-based rendering (DIBR)," Vis., Imaging, Image Process., pp. 482-487, 2003.
  15. L. Zhang and W. J. Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Trans. Broadcasting., vol. 51, no. 2, pp. 191-199, June 2005. https://doi.org/10.1109/TBC.2005.846190
  16. F. Endres, J. Hess, J. Sturm, D. Cremers, and W. Burgard, "3D mapping with an RGBD camera," IEEE Trans. Robotics, vol. 30, no. 1, Feb. 2014.
  17. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced computer vision with Microsoft Kinect sensor: A review," IEEE Trans. Cybernet., vol. 43, no. 5, Oct. 2013.
  18. M. Zhao, C.-W. Fu, J. Cai, and T.-J. Cham, "Real-time and temporal-coherent foreground extraction with commodity RGBD camera," IEEE Journal of selected topics in signal processing, vol. 9, no. 3, Apr. 2015.
  19. C. Rennie, R. Shome, K. E. Bekris, and A. F. De Souza, "A dataset for improved RGBD-based object detection and pose estimation for warehouse pick-and-place," IEEE Robot. Auto. Lett., vol. 1, no. 2, pp.1179-1185, July 2016. https://doi.org/10.1109/LRA.2016.2532924
  20. D.-H. Shin, S.-H.Lee, E.-S.Kim, "Optical display of true 3D object in depth-priority integral imaging using an active sensor," Optical Comm., vol. 275, no. 2, pp. 330-334, Jul. 2007. https://doi.org/10.1016/j.optcom.2007.03.072
  21. G. Li, K.-C. Kwon, G.-H. Shin, J.-S. Jeong, K.-H. Yoo, and N. Kim, "Simplified integral imaging pickup method for real objects using a depth camera," J. Optical Society of Korea, vol. 16, no. 4, pp. 381-385, Dec. 2012. https://doi.org/10.3807/JOSK.2012.16.4.381
  22. D. Hiyama, T. Shimobaba, T. Kakue, and T. Ito, "Acceleration of color computer-generated hologram from RGBD images using color space conversion," Elsevier Optics Communications, vol. 340, no. 1, pp.121-125, Apr. 2015.
  23. K.-C. Kwon, C. Park, M.-U. Erdeneat, J.-S. Jeong, J.-H. Choi, N. Kim, J.-H. Park, Y.-T. Lim, and K.-H. Yoo, "High speed image space parallel processing for computer-generated integral imaging system," Optics Express, vol. 20, no. 2, pp. 732-740, Jan. 2012. https://doi.org/10.1364/OE.20.000732
  24. Y. Deng, Y. Liu, Q. Dai, Z. Zhang, and Y. Wang, "Depth maps fusion for multiview stereo via matrix completion," IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 5, pp. 566-582, Sept. 2012. https://doi.org/10.1109/JSTSP.2012.2195472
  25. Y. Deng, Q. Dai, R. Liu, Z. Zhang, and S. Hu, "Low-rank structure learning via nonconvex heuristic recovery," IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 3, pp. 383-396, March 2013. https://doi.org/10.1109/TNNLS.2012.2235082
  26. Y. Gao, G. Cheung, T. Maugey, P. Frossard, and J. Liang, "Encoder-driven inpainting strategy in multiview video compression," IEEE Trans. Image Process. vol. 25, no. 1, Jan. 2016.

Cited by

  1. 짝수 홀수 분해 기반의 가중 선형 보간법을 위한 커널 분석 vol.22, pp.11, 2018, https://doi.org/10.6109/jkiice.2018.22.11.1455