Journal of Korea Society of Industrial Information Systems (한국산업정보학회논문지)

Korea Society of Industrial Information Systems (한국산업정보학회)
권호 표지
DOI QR코드

DOI QR Code

Improvement of Depth Video Coding by Plane Modeling

평면 모델링을 통한 깊이 영상 부호화의 개선

  • 이동석 (동의대학교 컴퓨터소프트웨어공학과) ;
  • 권순각 (동의대학교 컴퓨터소프트웨어공학과)
  • Received : 2016.10.13
  • Accepted : 2016.10.19
  • Published : 2016.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a method of correcting depth image by the plane modeling and then improving the coding performance. We model a plane by using the least squares method to the horizontal and vertical directions including the target pixel, and then determine that the predicted plane is suitable from the estimate error. After that, we correct the target pixel by the plane mode. The proposed method can correct not only the depth image composed the plane but also the complex depth image. From the simulation result that measures the entropy power, which can estimate the coding performance, we can see that the coding performance by the proposed method is improved up to 80.2%.

본 논문에서는 평면을 모델링하여 깊이 정보를 보정하고 부호화를 개선하는 방법을 제안한다. 먼저 보정하고자 하는 화소를 중심으로 수평, 수직 방향으로 최소 자승법을 이용하여 평면을 모델링한 후 예측 오차에 근거하여 예측된 평면이 적합한지 판단한다. 그 후 모델링된 평면상의 깊이 화소 값으로 보정한다. 제안된 방법을 통해 평면으로 이루어진 깊이 영상뿐만 아니라 다양한 깊이 정보를 가지는 깊이 영상에 대해서도 보정이 가능하다. 제안된 방법을 적용하여 부호화 성능을 나타내는 엔트로피 척도를 측정한 결과, 부호화 성능이 최대 80.2% 개선된 것을 확인하였다.

Keywords

References

  1. S. Y. Kim, C. Y. Yoon, and E. J. Yu, "A Study on the Development of Learning Contents of Augmented Reality by Perception Rate and Speeding," The Journal of Internet Electronic Commerce Resarch, Vol. 14, No. 4, pp. 313-333, 2014.
  2. S. Y. Kim and S. M. Lee, "Implementation of an Image Board Remote Control System Using PDA Based on Embedded Linux in Wireless Internet," The Journal of Information Systems, Vol. 17, No. 1, pp. 155-171, 2008. https://doi.org/10.5859/KAIS.2008.17.1.155
  3. R. M. Salinas, R. Medina-Carnicer, F. J. Madrid-Cuevas, and A. Carmona-Poyato, "Depth Silhouettes for Gesture Recognition," Pattern Recognition Letters, Vol.29, No.3, pp.319-329, 2008. https://doi.org/10.1016/j.patrec.2007.10.011
  4. P. Suryanarayan, A. Subramanian, and D. Mandalapu, "Dynamic Hand Pose Recognition Using Depth Data," Proceeding of 20th International Conference on Pattern Recognition, pp. 3105-3108, 2010.
  5. M. Zollhoefer, M. Martinek, G. Greiner, M. Stamminger, and J. Suessmuth, "Automatic Reconstruction of Personalized Avatars From 3d Face Scans," Computer Animation and Virtual Worlds, Vol. 22, No. 2-3, pp. 195-202, 2011. https://doi.org/10.1002/cav.405
  6. J. Tong, J. Zhou, L. Liu, Z. Pan, and H. Yan, "Scanning 3D Full Human Bodies Using Kinects," IEEE Transactions on Visualization and Computer Graphics, Vol. 18, No. 4, pp. 643-650, 2012. https://doi.org/10.1109/TVCG.2012.56
  7. B. Choo, M. Landau, M. Devore, and P. A. Beling, "Statistical Analysis-Based Error Models for the Microsoft KinectTM Depth Sensor," Sensors, Vol. 14, No. 9, pp. 17430-17450, 2014. https://doi.org/10.3390/s140917430
  8. C. V. Nguyen, S. Izadi, and D. Lovell, "Modeling Kinect Sensor Noise for Improved 3d Reconstruction and Tracking," 3D Imaging, Modeling, Proceeding of 2012 Second International Conference on Processing, Visualization and Transmission, pp. 524-530, 2012.
  9. Y. S. Kim, B, M. Kang, H. S. Lim, O. Choi, K. C. Lee, J. D. K. Kim, and C, Y, Kim, "Parametric Model-Based Noise Reduction for ToF Depth Sensors," Proceeding of SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, pp. 82900A-82900A-8, 2012.
  10. A. Belhedi, A. Bartoli, V, Gay-Bellile, S. Bourgeois, P. Sayd, and K. Hamrouni, "Non-Parametric Depth Calibration of a Tof Camera," Proceeding of 2012 19th IEEE International Conference on Image Processing, pp. 549-552, 2012.
  11. D. Herrera, J. Kannala, and J. Heikkila, "Joint Depth and Color Camera Calibration with Distortion Correction," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, No. 10, pp. 2058-2064, 2012. https://doi.org/10.1109/TPAMI.2012.125
  12. R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision," Cambridge University Press, Cambridge, UK, 2008.
  13. S. K. Kwon and D. S. Lee, "Obtainment of Background Image Using Depth Information," International Organization of Scientific Research Journal of Engineering, Vol. 5, No. 8, pp. 43-46, 2015.