Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Focal Stack Based Light Field Coding for Refocusing Applications

  • Duong, Vinh Van (Department of Electrical and Computer Engineering, Sungkyunkwan University) ;
  • Canh, Thuong Nguyen (Department of Electrical and Computer Engineering, Sungkyunkwan University) ;
  • Huu, Thuc Nguyen (Department of Electrical and Computer Engineering, Sungkyunkwan University) ;
  • Jeon, Byeungwoo (Department of Electrical and Computer Engineering, Sungkyunkwan University)
  • Received : 2019.10.21
  • Accepted : 2019.12.13
  • Published : 2019.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

Since light field (LF) image has huge data volume, it requires high-performance compression technique for efficient transmission and storage of its data. Camera users may like to represent parts of image at different levels of focus at their choice anytime. To address this refocusing functionality, in this paper, we first render a focal stack consisting of multi-focus images, then compress it instead of original LF data. The proposed method has advantage of minimizing the amount of LF data to realize the targeted refocusing applications. Our experiment results show that the proposed method outperforms the state-of-the-art for LF image compression method.

Keywords

References

  1. G. Lippmann, "Epreuves reversibles, photographies integrales," Academie des sciences, pp. 446-451, 1908.
  2. H. Ives, "A Camera for Making Parallax Panoramagrams," J. Opt. Soc. Am., vol. 17, no. 4, pp. 435-439, 1928. https://doi.org/10.1364/JOSA.17.000435
  3. M. Levoy, et al., "Light field microscopy," ACM Trans. Graph., vol. 25, no. 3, pp. 924-934, Jul. 2006. https://doi.org/10.1145/1141911.1141976
  4. K. Fife, et al., "A 3mpixel multi-aperture image sensor with 0.7um pixels in 0.11um cmos," IEEE ISSCC Digest of Technical Papers, pp.48-49, 2008.
  5. R. Ng, et al., "Light field photography with a hand-held plenoptic camera," in Computer Science Technical Report, vol. 2, no. 11, pp. 111, 2005.
  6. ISO/IEC JTC 1/SC29/WG1 JPEG, "JPEG Pleno Call for Proposals on Light Field Coding," in ISO/IEC JTC 1/SC29/WG1 JPEG, Doc. N74014, Jan 2017.
  7. M. Rerabek, et al., "ICME 2016 grand challenge: Light-field image compression," Call for proposals and evaluation procedure, 2016.
  8. I. Viola and T. Ebrahimi, "Quality Assessment of Compression Solutions for ICIP 2017 Grand Challenge on Light Field Image Coding," in Proc. 9th Workshop on Hot Topics in 3D Multimedia, July 2018.
  9. ICME 2018 Grand Challenge on Densely Sampled Light Field Reconstruction, available at http://www.tut.fi/civit/icme-2018-grandchallenge-densely-sampled-light-field-reconstruction/.
  10. M. Rizkallah, et al., "Impact of light field compression on refocused and extended focus images," in Proc. European Conf. Sig. Process., pp. 898-902, 2016.
  11. C. Perra, et al., "Effect of light field subsampling on the quality of experience in refocusing applications," in Proc. IEEE Int. Conf. Quality Multi. Exper., 2018.
  12. P. Paudyal, et al., "Towards the perceptual quality evaluation of compressed light field images," IEEE Trans. Broadcast., vol. 63, no. 3, pp. 507-522, Sep. 2017. https://doi.org/10.1109/TBC.2017.2704430
  13. P. A. Kara, et al., "Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video," IEEE Trans. Broadcast., vol. 64, no. 2, pp. 407-421, June 2018. https://doi.org/10.1109/tbc.2018.2834736
  14. A. Levin and F. Durand, "Linear views sythesis using a dimensionality gap light field prior," in Proc. IEEE Conf. Comp. Vision Pattern Recog., pp. 1831-1838, 2010.
  15. S. Pertuz, et al., "Focus model for metric depth estimation in standard plenoptic cameras," in SPRS Journal of Photogrammetry and Remote Sensing, vol. 144, pp. 38-47, Oct. 2018. https://doi.org/10.1016/j.isprsjprs.2018.06.020
  16. M. Levoy and P. Hanrahan, "Light field rendering," in SIGGRAPH, 1996, pp. 31-42.
  17. D. Dansereau, "Light Field Toolbox v0.4", available at https://www.mathworks.com/matlabcentral/fileexchange/49683-light-field-toolbox-v0-4.
  18. I. Viola, et al., "Comparison and evaluation of light field image coding approaches," IEEE J. Select. Topic Sig. Process., vol. 11, no. 7, pp. 1092-1106, 2017. https://doi.org/10.1109/JSTSP.2017.2740167
  19. T. N. Canh, V. V. Duong, and B. Jeon, "Boundary handling for video based light field coding with a new hybrid scan order," in Proc. Inter. Workshop on Advanced Image Tech., pp. 1-4, Jan. 2019.
  20. V. V. Duong, T. N. Canh, and B. Jeon, "Light Field Image Coding for Efficient Refocusing," in Proc. IEEE 12th Inter. Symp. Emb. Multi./Many-core Sys. On Chip, pp. 74-78, Sept. 2018.
  21. T. Sakamoto, et al., "A study on efficient compression of multi-focus images for dense light field reconstruction," in Proc. Vis. Commum. Image Processing(VCIP), pp. 1-4, Nov 2016.
  22. A. Mousnier, et al., "Partial light field tomographic reconstruction from a fixed camera focal stack," available at http://www.irisa.fr/temics/demos/lightField/LightFieldPartialReconstruction.html.
  23. Y. Boykov, O. Veksler, and R. Zabih, "Efficient approximate energy minimization via graph cuts," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, no. 12, pp. 1222-1239, Nov. 2001.
  24. HEVC reference software, HM 16.17, available at https://hevc.hhi.fraunhofer. de/svn/svn_HEVCSoftware/.
  25. M. Rerabek and T. Ebrahimi, "New light field image dataset," in Proc. 8th Int. Conf. Quality Multi. Exp., pp. 1 -2, 2016.
  26. G. Bjontegaard, "Calculation of Average PSNR Differences Between RDCurves," document ITU-T SG16 Q.6, VCEG-M33, Geneva, Switzerland, Apr. 2001.
  27. F. Perez, et al., "Lightfield recovery from its focal stack," J. Math. Imag. Vis., vol. 56, no. 3, pp. 573-590, 2016. https://doi.org/10.1007/s10851-016-0658-4