다시점 동영상에서의 효율적인 변이 벡터 압축 기법

Multi-view video coding using efficient disparity vector prediction

  • 김용태 (연세대학교 전기전자공학과) ;
  • 손광훈 (연세대학교 전기전자공학과)
  • Kim, Yong-Tae (Dept. of Electrical and Electronic Engineering, Yonsei University) ;
  • Sohn, Kwang-Hoon (Dept. of Electrical and Electronic Engineering, Yonsei University)
  • 발행 : 2005.12.01

초록

다시점 동영상 부호화기의 성능을 향상시키기 위해서 본 논문에서는 평행식 카메라 구조에서의 효율적인 변이 벡터 예측을 이용한 부호화 방식을 제안한다 변이 벡터는 움직임 벡터와는 달리 다시점 카메라 구조 정보로부터 예측이 가능하다. 이러한 성질을 이용하여 예측하여 구한 예측 벡터와 직접 추정한 변이 벡터와의 차이값을 부호화한다. 그러므로 변이 벡터 부호화의 성능을 향상시키기 위해서 정교한 변이 벡터의 예측이 필요하다. 기존의 벡터 예측 방식은 미리 부호화된 주위 블록의 변이 벡터를 이용하여 현재 블록의 변이 벡터를 예측하지만 제안 알고리듬은 다시점 영상간의 상관성을 이용한다. 본 논문에서는 5시점 동영상에 대해서 차벡터의 엔트로피와 절대 평균값을 구하는 실험을 수행하였다. 실험 결과를 통해서 기존의 공간적인 상관성만을 이용하여 변이 벡터를 부호화하는 방식보다 제안 알고리듬이 우수한 성능을 보임을 확인하였다. 제안 알고리듬은 기존알고리듬과 비교하여 영상의 화질을 유지하면서 $30{\~}40\%$의 부호화 효율을 증가시킨다.

To enhance the performance of multi-view sequence CODEC, an efficient disparity vector coding method fur multiview sequences is proposed herein. For higher coding efficiency, we encode the differential vectors acquired by subtracting the original vectors from the predicted ones. To enhance the performance of disparity vector coding, it is essential to predict the disparity vectors accurately. The prediction by this proposed method utilizes the correlation among the multiview images, while conventional methods exploit the correlation among the causal blocks. Experiments were performed fur three different 5 view sequences. We were able to confirm that the proposed method predicts disparity vectors accurately by comparing the entropy and the mean absolute values for differential vectors with conventional methods. Its performance is superior to vector coding methods used in MPEG-4 which uses only a spatial correlation. The proposed method increases the coding efficiency by a factor of $30{\~}45\%$ while preserving image quality.

키워드

참고문헌

  1. G.C Chang and W.N. Lie, Multi-View Image Compression and Intermediate View Synthesis For Stereoscopic Applications, IEEE International Symposium on Circuits and Systems, ISCAS 2000, vol. 2, pp. 277-280, May, 2000
  2. Y. Zhang and G. Li, An efficient hierarchical disparity estimation algorithm for stereoscopic video coding, IEEE Asia-Pacific Conference on Circuits and Systems, pp. 744-747, December, 2000
  3. D.R. Clewer, L.J. Luo, C.N. Canagarajah, D.R. Bull and M.H. Barton, Efficient multiview image compression using quadtree disparity estimation, IEEE International Symposium on Circuits and Systems, vol. 5 pp. 295-298, May, 2001
  4. S. Pastoor and K. Schenke, Subjective Assenssments of the Resolution of Vewing Directions in a Multi-Viewpoint 3D TV System, Proc. SID, vol.3, no.3, pp. 217-222, 1989
  5. A. Tamtaou and C. Labit, Coherent disparity and motion compensation in 3DTV image sequence coding schemes, in ICASSP, pp. 2845-2848, 1991
  6. L. Oisel, E. Memin, L. Morin and F. Galpin, One-Dimensional Dense Disparity Estimation for Three-Dimensional Reconstruction, IEEE Trans. Image Processing, vol. 12, no. 9, pp. 1107-1119, September, 2003 https://doi.org/10.1109/TIP.2003.815257
  7. H. Aydinoglu and M.H. Hate, Stereo image coding : A projection approach, IEEE Trans. Image Processing, vol. 7, no. 4, pp. 506-516, April, 1998 https://doi.org/10.1109/83.663495
  8. N. Grammalidis and M.G. Strintzis, Disparity and occlusion estimation in multiocular systems and their sequences, IEEE Trans. Circuits and Systems for Video Technol. vol. 8, no. 3, pp. 329-343, June, 1998
  9. E. Izquierdo, Stereo Matching for Enhanced Telepresence in Three-Dimensional Videodcommunications, IEEE Trnas. Circuits and Systems for Video Technol., vol. 7, no. 4, pp. 629-643, August, 1997 https://doi.org/10.1109/76.611174
  10. D. Tzovaras, N. Grammalidis and M. G. Strintzis, Object-Based Coding of Stereo Image Sequences Using Joint 3-D Motion/ Disparity Compensation, IEEE Trans. Circuits and Systems for Video Technol., vol. 7, no. 4, pp. 312-327, April, 1997 https://doi.org/10.1109/76.564110
  11. K.H. Sohn, J.R. Ryou and J. Lim, Efficient stereoscopic video coding using joint disparity-motion estimation, Circuits, Systems and Signal Processing, vol. 23, no. 1, pp. 57-76, Jan., 2003
  12. G. Egnal and R.P. Wildes, Detecting binocular half-occlusions: empirical comparisons of five approaches, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 8, pp. 1127-1133, June, 2000 https://doi.org/10.1109/TPAMI.2002.1023808
  13. G.A. Triantafylldis, D. Tzovaras and M.G. Strintzis, Detection of occlusion and visible background and foreground areas in stereo image pairs, Proc. IEEE 9th International Conference on Electronics, Circuits and Systems, vol. 3, pp. 1019-1022, September, 2002 https://doi.org/10.1109/ICECS.2002.1046423