Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Human Perception of Asymmetrical Three-Dimensional Image

비대칭적 3차원 영상에 대한 인간의 인지 특성

  • Ha, Chang-Woo (Department of Electronics and Computer Engineering, Hanyang University) ;
  • Lee, Wan-Jae (Department of Electronics and Computer Engineering, Hanyang University) ;
  • Jin, Soon-Jong (Department of Electronics and Computer Engineering, Hanyang University) ;
  • Jeong, Je-Chang (Department of Electronics and Computer Engineering, Hanyang University)
  • 하창우 (한양대학교 전자통신컴퓨터공학과) ;
  • 이완재 (한양대학교 전자통신컴퓨터공학과) ;
  • 진순종 (한양대학교 전자통신컴퓨터공학과) ;
  • 정제창 (한양대학교 전자통신컴퓨터공학과)
  • Published : 2007.01.29
Download PDF
⟨ Previous Next ⟩

Abstract

The 3DTV services can be seen as a general case of the multi-view video that has been receiving a significant attention lately. However, the key factors that influence the success of 3DTV are the availability of content, the ease of use, the quality of contents, and the reduction of cost. This paper deals primarily with the perceptual improvement in image quality, especially based on human factors. An optimal asymmetrical coding method for binocular and multi-view images is presented. The quantitative value of asymmetrical rate to maintain optimized subjective image quality is explored. Also we analyze how edges of 2D images affect on 3D perceptions and propose an edge-preserving algorithm to perform perceptual improvements. Experimental results demonstrate that the proposed algorithm enhances subjective image quality much better than conventional methods.

다시점 비디오의 일반적인 형태인 3차원 방송 서비스는 최근 많은 관심을 받고 있다. 그렇지만 3차원 방송의 성공을 위해서는 상용 가능한 컨텐츠의 개발, 사용의 용이성, 방송 품질 개선, 비용 절감 등의 과제가 남아있다. 본 논문은 이러한 과제들 중 방송 품질 개선 측면, 특히 인간 요소를 고려한 주관적 화질 개선을 중심으로 접근하여 양안식 영상과 다시점 영상에 적합한 비대칭 코딩 방법을 설명하고 최적의 주관적 화질을 유지하는 비대칭 율의 정량적인 값을 제안한다. 또한 저화질의 2차원 영상들의 경계선들이 3차원 영상의 인지에 미치는 영향을 실험적으로 분석하고 경계선 왜곡의 문제점을 주관적 화질 측면에서 개선하는 경계선 보호 알고리듬을 제안한다. 실험 결과를 통해 기존의 부호화 방법보다 주관적 화질을 개선시킴을 확인하였다.

Keywords

References

  1. 박경세, '입체 TV 방송 기술,' 커뮤니케이션북스, 2004
  2. 이형철, 김은수, '3D 방송 시스템 개발에서의 심리학의 역할 및 기여,' 한국방송공학회지, 제6권, 제2호, pp. 10-21, 6월, 2001
  3. ISO/IEC JTC1/SC29/WG11 Doc. N8064, Montreux, Switzerland, Apr. 2006
  4. W.A. Ijsselsteijn, P. J. H. Seutiens and L. M. J. Meesters, 'State-of-the -art in human factors and quality issues of stereoscopic broadcast television,' Deliverable ATTEST/WP5/01, pp. 43-57, Aug. 2002
  5. J.V. Draper, S. Handel, C.C. Hood, and C.T. Kring, 'Three experiments with stereoscopic television: when it works and why,' IEEE International Conference on Systems, Man, and Cybernetics, Vol. 2, pp. 1047-1052, Oct. 1991
  6. M.A. Livingston, C. Zanbaka, J. E. Swan II, and H.S. Smallman, 'Objective measures for the effectiveness of augmented reality,' Proceedings of IEEE Virtual Reality, pp. 287-288, Mar. 2005
  7. M.A. Livingston, 'Evaluating factors in augmented reality systems,' IEEE Computer Graphics and Applications, Vol. 25, pp. 6-9, Nov.-Dec. 2005
  8. Lydia M. J. Meesters, Wijnand A. IJsselsteijn, and Pieter J. H. Seuntiëns, 'A Survey of Perceptual Evaluations and Requirements of Three-Dimensional TV,' IEEE Transactions on Circuits and System, Vol. 14, NO. 3, pp. 381-391, Mar. 2004
  9. ISO/IEC JTC1/SC29/WG11 N7539, Requirements on Multi-view Video Coding v.5, Nice, France, Oct. 2005
  10. S. Yano, and I. Yuyama, 'Stereoscopic HDTV:Experimental system and psychological effects,' Journal of the SMPTE , Vol. 100, pp. 14-18, Jan. 1991 https://doi.org/10.5594/J02092
  11. S.Pastoor, '3D Television: A survey of recent research results on subjective requirements,' Signal Processing: Image Communication, Vol.4, No.1, pp. 21-32, Nov. 1991 https://doi.org/10.1016/0923-5965(91)90057-9
  12. T. Mitsuhashi, 'Subjective Image Position in Stereoscopic TV Systems - Considerations on Comfortable Stereoscopic Images,' Proceedings of the SPIE, Vol. 2179, pp. 259–266, Mar. 1994
  13. L. B. Stelmach and W. J. Tam, 'Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views,' Signal Processing: Image Communication, Vol. 14, No. 1-2, pp. 111-117, 1998 https://doi.org/10.1016/S0923-5965(98)00031-9
  14. 손광훈, 임정은, '3차원 영상 부호화 기술,' 한국광학회, 제5권, 제3호, pp. 32-37, 7월, 2001
  15. 엄기문, 안충현, '3차원 방송을 위한 휴먼 팩터 기술 연구 동향,' 정보 통신연구진흥원(ITA), 주간기술동향 통권 1099호, 2003
  16. L. B. Stelmach, W. J. Tam, D. V. Meegan, A. Vincent, and P. Corriveau, 'Human Perception of Mismatched Stereoscopic 3D Input,' 2000 International conference on Image processing, Vol.1, pp. 5-8, Sept. 2000
  17. ITU-R Recommendation BT.500-11, 'Methodology for subjective assessment of the quality of television picture'
  18. T. Wiegand, G. Sullivan, j. Bjontegaard, and G. A. Luthra, 'Overview of the H.264/AVC video coding standard,' IEEE Trans. Circuits System, Video Technol, Vol.13, No.7, pp. 560-576, July, 2003 https://doi.org/10.1109/TCSVT.2003.815165
  19. Online avaliable : http://iphome.hhi.de/suehring/tml/
  20. 'Proposed Draft of Adaptive Rate Control,' Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG 8th Meeting: Document: JVT-H017 Filename: JVT-. H017.doc, Geneva, May, 2003