• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.234-236
• /
• 2010

본 논문에서는 한 장의 영상을 가상 카메라와 깊이맵을 이용하여 영상 내부를 네비게이션하는 입체 자유시점 비디오를 제안한다. 이 분야는 한장 또는 여러장의 사진 내부를 탐험하면서 애니메이션으로 볼 수 있게 하는 기술이다. 제안 방법은 전처리과정으로 전경 마스크, 배경영상, 및 깊이맵을 자동 및 수동 방법으로 구한다. 다음에는 영상 내부를 항해하면서 투영 영상들을 획득한다. 배경영상과 전객객체의 3D 모델링 데이터를 기반으로 가상 카메라의 3차원 공간 이동, yaw, pitch, rolling의 회전, look-around effect, 줌인 등의 다양한 카메라 기능을 활용하여 자유시점 비디오를 구현한다. 소프트웨어는 OpenGL 및 MFC Visual C++ 기반으로 구축되었으며, 실험영상으로 조선시대의 작품인 김홍도의 무이귀도를 사용하였고, 입체영상으로 제작되어 보다 실감있는 자유시점 콘텐츠를 제공한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.376-377
• /
• 2011

본 논문에서는 스테레오스코픽 영상 및 깊이 프레임 오류 은닉 알고리즘을 제안한다. i) 좌측 컬러 프레임 오류 발생시 시간적 상관관계를 이용하여 프레임을 복원한다. iii) 우측 컬러 프레임 오류 발생시 깊이 정보 및 DIBR 기법을 이용하여 좌 우 시점간의 매칭 픽셀을 예측하고, 매칭된 픽셀의 움직임 벡터 및 밝기 차이를 이용하여 프레임을 복원한다. iii) 좌측 깊이 프레임과 iv) 우측 깊이 프레임의 오류 발생시 좌 우측 컬러 프레임의 움직임 벡터를 이용하여 손실된 프레임을 복원한다. 컴퓨터 모의 실험을 통해 제안하는 알고리즘의 스테레오스코픽 컬러 및 깊이 프레임 오류 복원 성능을 확인한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.11a
• /
• pp.42-43
• /
• 2012

최근 양안식 3D 디스플레이의 시청 안정성 문제가 대두됨에 따라, 어떠한 요인들이 시각피로와 시각적 불편함을 야기하는지 밝히는 연구의 필요성이 증가하고 있다. 시각적 불편함은 양안식 3D 영상에서 과도한 양안 시차, 양안 시차의 빠른 변화, 양안 불일치 등에 의해 야기될 수 있다. 그러나 시각적 불편함은 시각시스템의 복잡한 메커니즘에 의한 결과이므로 알려진 양안 시차 등의 요인 외에도 밝혀지지 않은 요인들이 더 존재할 수 있다. 본 논문은 기존 연구로부터 시각적 불편함과 관련 있을 것으로 추정되는 요인으로 시각자극의 너비와 시각적 불편함에 대한 민감도를 선택하였다. 이들의 영향을 밝히기 위한 실험으로서, 편안한 양안 시차 범위 내에서 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 어떻게 달라지는지를 관찰하였다. 실험 결과로부터 편안한 양안 시차 범위 내에서도 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 크게 달라짐을 확인할 수 있었다. 이러한 결과들은 시각자극의 너비가 주요한 시각적 불편함의 3D 콘텐츠 요인이 될 수 있음을 암시한다.

• Journal of Broadcast Engineering
• /
• v.19 no.5
• /
• pp.677-686
• /
• 2014

This paper analyzes the 3D accuracy of stereo images captured from a mobile phone. For 3D accuracy evaluation, we have compared the accuracy result according to the amount of the convergence angle. In order to calculate the 3D model space coordinate of control points, we perform inner orientation, distortion correction and image geometry estimation. And the quantitative 3D accuracy was evaluated by transforming the 3D model space coordinate into the 3D object space coordinate. The result showed that relatively precise 3D information is generated in more than $17^{\circ}$ convergence angle. Consequently, it is necessary to set up stereo model structure consisting adequate convergence angle as an measurement distance and a baseline distance for accurate 3D information generation. It is expected that the result would be used to stereoscopic 3D contents and 3D reconstruction from images captured by a mobile phone camera.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.416-424
• /
• 2013

Recently, efforts have been made to develop international standards related to 3DTV quality assessment underway in International Telecommunication Union and Video Quality Experts Group. Unlike conventional 2D displays, there are several types of 3D display monitors: passive glasses, active glasses and auto-stereoscopic. In this paper, we performed subjective video quality tests using various 3D display monitors, in order to examine whether these display monitors can produce consistent perceptual video quality scores for processed video sequences. The experimental results show that the subjective scores of those 3D monitors are highly correlated and it appears that similar subjective scores will be obtained even when different types of 3D displays are used.

• Journal of Broadcast Engineering
• /
• v.22 no.3
• /
• pp.401-404
• /
• 2017

The 360 VR video has a format of a stereoscopic shape such as an isometric shape or a cubic shape or a cubic shape. Although these formats have different characteristics, they have in common that the resolution is higher than that of a normal 2D video. Therefore, it takes much longer time to perform coding/decoding on 360 VR video than 2D Video, so parallel processing techniques are essential when it comes to coding 360 VR video. HEVC, the state of art 2D video codec, uses Wavefront Parallel Processing (WPP) technology as a standard for parallelization. This technique is optimized for 2D videos and does not show optimal performance when used in 3D videos. Therefore, a suitable method for WPP is required for 3D video. In this paper, we propose WPP coding/decoding method which improves WPP performance on cube map format 3D video. The experiment was applied to the HEVC reference software HM 12.0. The experimental results show that there is no significant loss of PSNR compared with the existing WPP, and the coding complexity of 15% to 20% is further reduced. The proposed method is expected to be included in the future 3D VR video codecs.

• Journal of Broadcast Engineering
• /
• v.19 no.6
• /
• pp.896-906
• /
• 2014

In this paper, a real-time dual-mode temporal synchronization and compensation method based on a new reliability measure in stereoscopic video is proposed. The goal of temporal alignment is to detect the temporal asynchrony and recover synchronization of the two video streams. The accuracy of the temporal synchronization algorithm depends on the 3DTV contents. In order to compensate the temporal synchronization error, it is necessary to judge whether the result of the temporal synchronization is reliable or not. Based on our recently developed temporal synchronization method[1], we define a new reliability measure for the result of the temporal synchronization method. Furthermore, we developed a dual-mode temporal synchronization method, which uses a usual texture matching method and the temporal spatiogram method[1]. The new reliability measure is based on two distinctive features, a dynamic feature for scene change and a matching distinction feature. Various experimental results show the effectiveness of the proposed method. The proposed algorithms are evaluated and verified through an experimental system implemented for 3DTV.

• Journal of Broadcast Engineering
• /
• v.19 no.5
• /
• pp.687-698
• /
• 2014

ATSC is currently working on standardization of hybrid 3DTV broadcasting service in heterogenous network environment after completion of service-compatible 3DTV broadcasting service standard based on broadcasting channel. This paper proposes a convergence 3D video broadcasting method on broadcasting and IP network while guaranteeing a Full-HD 3D quality without degrading the image quality of legacy DTV. Specifically, this paper describes transmission of the 3D additional video using the ISO/IEC 23009-1 DASH, robust synchronization method under heterogenous network environments and system target decoder model for hybrid 3DTV receiver. Based on experimental results, we confirm that proposed technologies can be used as a core technology in the hybrid 3DTV standardization and a reference model for a development of hybrid 3DTV encoder and receiver.

• Journal of Broadcast Engineering
• /
• v.22 no.4
• /
• pp.429-437
• /
• 2017

2D-to-3D conversion technology has been studied over past decades and integrated to commercial 3D displays and 3DTVs. Generally, depth cues extracted from a static image is used for generating a depth map followed by DIBR (Depth Image Based Rendering) for producing a stereoscopic image. Further, motion is also an important cue for depth estimation and is estimated by block-based motion estimation, optical flow and so forth. This papers proposes a new method for motion depth generation using Motion History Image (MHI) and evaluates the feasiblity of the MHI utilization. In the experiments, the proposed method was performed on eight video clips with a variety of motion classes. From a qualitative test on motion depth maps as well as the comparison of the processing time, we validated the feasibility of the proposed method.

• Journal of Broadcast Engineering
• /
• v.7 no.3
• /
• pp.211-218
• /
• 2002

This paper introduces the HD 3DTV camera and 3DTV receiver that are compatible with the ATSC HDTV broadcasting system. The developed 3DTV camera is based on stereoscopic techniques, and it has control function to control both left and right zoom lens simultaneously and to control the vergence. Moreover, in order to control the vergence manually and to eliminate the synchronization problem of the both images, the 3DTV camera has the 3DTV video multiplexing function to combine the left and right images into the single image. The developed 3DTV signal, and it has the various analog/digital interfaces. The performance of the developed system is confirmed by shooting the selected soccer game in 2002 FIFA KOREA/JAPANTM World Cup and by broadcasting the match. The HD 3DTV camera and receiver will be applied to the 3DTV industries such as 3D movie, 3D game, 3D image processing, 3DTV broadcasting system, and so on.