• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.620-624
• /
• 2009

In this paper, we present a new camera system combining a high-quality 3-D scanner and hybrid camera system to generate a multiview video-plus-depth. In order to get the 3-D video using the hybrid camera system and 3-D scanner, we first obtain depth information for background region from the 3-D scanner. Then, we get the depth map for foreground area from the hybrid camera system. Initial depths of each view image are estimated by performing 3-D warping with the depth information. Thereafter, multiview depth estimation using the initial depths is carried out to get each view initial disparity map. We correct the initial disparity map using a belief propagation algorithm so that we can generate the high-quality multiview disparity map. Finally, we refine depths of the foreground boundary using extracted edge information. Experimental results show that the proposed depth maps generation method produces a 3-D video with more accurate multiview depths and supports more natural 3-D views than the previous works.

• The Journal of the Korea Contents Association
• /
• v.14 no.2
• /
• pp.39-47
• /
• 2014

Fast advancement and dynamic diffusion of Smart device make big change to personal user. They have been extended from consumer only watching video to prosumer recording and sharing User Created Video(UCV). With this reason, as a platform for various kind of content service. Especially, UCVs for the purpose of sharing experience are recorded from same event on limited time and space by some people. These are also produced by various cameras that has each angle similar like broadcasting videos. In this paper, we present multi-view characteristic of UCV and propose Multi-view UCV service that is watching UCVs from same event through adjusting camera angle. Through user satisfaction survey, we knew that adjusting camera angle is preferred for watching UCV including overlapping part more than linear watching.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2007.02a
• /
• pp.9-12
• /
• 2007

다시점 동영상 부호화기는 서로 다른 카메라에 의해 영상을 획득하므로 카메라 내부 파라미터의 차이나 조명의 차이 및 변화 등에 의한 시점 간 명도 성분의 불균형을 가지고 있다. 이로 인해 잘못된 변이 추정이 이루어질 수 있으며, 따라서 전체적인 다시점 동영상 부호화의 성능을 크게 저하시킬 수 있다. 본 논문에서는 레지듀얼이 가지고 있는 밝기 차 정보를 이용하여 시점 간의 불균형을 해소하는 가중치 예측 알고리듬을 제안한다. 주변의 인과적인 블록의 레지듀얼 정보를 이용하여 현재 블록과 참조 블록의 밝기 차를 예측하고, 이 값을 이용해 시점 간 불균형을 보정 한 후 변이 추정을 수행한다. 변이 보상 후 계산된 현재 블록의 레지듀얼 평균값을 앞에서 예측된 밝기 차의 값에 누적하여 다음 블록의 밝기 차 예측에 사용한다. 제안된 방법을 실험 영상에 적용한 결과 평균적으로 약 0.2dB의 이득을 얻었다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.12
• /
• pp.2527-2533
• /
• 2011

In this paper we propose a new pre-processing algorithm applied to multi-view video coding using color compensation algorithm based on image features. Multi-view images have a difference between neighboring frames according to illumination and different camera characteristics. To compensate this color difference, first we model the characteristics of cameras based on frame's feature from each camera and then correct the color difference. To extract corresponding features from each frame, we use Harris corner detection algorithm and characteristic coefficients used in the model is estimated by using Gauss-Newton algorithm. In this algorithm, we compensate RGB components of target images, separately from the reference image. The experimental results with many test images show that the proposed algorithm peformed better than the histogram based algorithm as much as 14 % of bit reduction and 0.5 dB ~ 0.8dB of PSNR enhancement.

• Journal of Broadcast Engineering
• /
• v.9 no.3
• /
• pp.236-245
• /
• 2004

A multiview sequence CODEC with view scaiability is proposed in this paper. We define a GGOP (Group of GOP) structure as a basic coding unit to efficiently code multiview sequences. 7he proposed CODEC provides flexible GGOP structures based on the number of views and baseline distances among cameras. Multiview sequences encode consists of disparity estimation/compensation, motion estimation/compensation, residual coding and rate control and generates multiview sequence bitstream. The main bitstream is the same as an MPEG-2 mono-sequence bitstream for MPEG-2 compatibility. The auxiliary bitstream contains information concerning the remaining multiview sequences except for the reference sequences. The proposed CODEC with view scalability provides that a number of view flints are selectively determined at the receiver according to the type of display modes. The proposed multiview sequence CODEC is tested with several multiview sequences to determine its flexibility. compatibility with MPEG-2 and view scaiability. In addition, we subjectively confirm that the decoded bitstreams with view scaiability can be Properly displayed by several types of display modes. including 3D monitors.

• The Journal of the Korea Contents Association
• /
• v.8 no.7
• /
• pp.1-8
• /
• 2008

In this paper, an algorithm to compensate the inter-view mismatch in the multi-view video according to the different characteristics of cameras is presented. Interview mismatches make it difficult to merge the multi-view images and decrease the coding performance. So, a preprocessing operation to compensate the mismatches is requisite in the multi-view video coding. It is shown that the mismatch in the outputs of multi-view cameras with different electro-optical transfer functions can be approximated with a linear model of a gain and an offset. In addition, a new algorithm for estimating and compensating the inter-view mismatch based on the detection of the overlapped region is presented. Experimental results using various rectified stereo images show that the proposed method compensates inter-view mismatches more accurately compared to the conventional approach.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2005.11a
• /
• pp.21-24
• /
• 2005

본 논문에서는 3DTV를 위한 다시점 동영상 부호화 기법을 제안한다. 제안하는 다시점 동영상 부호화기는 다수의 카메라 입력에 대하여 기존의 MPEG 기반의 부호화 기법에서 사용된 시 ${\cdot}$ 공간적 중복성 제거와 각 시점에 해당하는 영상간의 공간적 중복성을 제거하여 부호화효율을 개선할 수 있다. 각 시점 영상간의 공간적 중복성을 효율적으로 제거하기 위하여 전역 시차보상(global disparity compensation)된 집적영상(Accumulated Image)를 사용하였다. 또한 기존의 디지털 TV 전송 표준인 MPEG-2를 기반으로 하였기 때문에 기존의 디지털 TV 표준을 크게 수정하지 않고 3DTV를 구현 할 수 있다. 제안하는 기법은 기존의 MPEG-2 기법으로 각 시점에 해당하는 영상을 각각 부호화한(simulcast 기법) 결과와 비교하여 객관적 화질면에서 우수하였으며, 각 시점간의 동기화 문제도 해결 할 수 있었다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.380-383
• /
• 2010

본 논문에서는 다시점 카메라를 기반으로 홀로그램 영상을 재생하는 기술을 제안한다. 본 논문에서는 다시점 카메라를 이용해 획득한 발레영상을 사용하여 깊이정보에서 관심객체만을 추출하였다. 추출한 관심객체의 홀로그램 복원화질을 향상시키기 위해 본 논문에서 제안한 함수를 적용하였다. 필터링된 관심객체의 깊이정보와 CGH(Computer-Generated Hologram) 기법을 이용하여 디지털 홀로그램을 생성하였다. 이 디지털 홀로그램을 PC 시뮬레이션을 통해 홀로그램 영상으로 복원한 후 제안한 기법의 적용결과를 주관적인 화질평가를 통해 검증하였다.

• Journal of Broadcast Engineering
• /
• v.25 no.4
• /
• pp.598-608
• /
• 2020

In this paper, we propose a color correction technique for images acquired through a multi-view camera system for acquiring a 3D model. It is assumed that the 3D volume is captured indoors, and the position and intensity of the light is constant over time. 8 multi-view cameras are used, and converging toward the center of the space, so even if the lighting is constant, the intensity and angle of light entering each camera may be different. Therefore, a color optimization function is applied to a color correction chart taken from all cameras, and a color conversion matrix defining a relationship between the obtained 8 images is calculated. Using this, the images of all cameras are corrected based on the standard color correction chart. This paper proposed a color correction method to minimize the color difference between cameras when acquiring an image using 8 cameras of 3D objects, and experimentally proved that the color difference between images is reduced when it is restored to a 3D image.

• The Journal of the Korea Contents Association
• /
• v.18 no.12
• /
• pp.35-45
• /
• 2018

Motion Estimation(ME) has been developed to reduce the redundant data in digital video signal. ME is an important part of video encoding system, However, it requires huge computational complexity of the encoder part, and fast motion search methods have been proposed to reduce huge complexity. Multi- view video is obtained by capturing on a three-dimensional scene with many cameras at different positions and its complexity increases in proportion to the number of cameras. In this paper, we proposed an efficient motion method which chooses a search pattern adaptively by using the temporal-spatial correlation of the block and the characteristics of the block. Experiment results show that the computational complexity reduction of the proposed method over TZ search method and FS method can be up to 70~75% and 99% respectively while keeping similar image quality and bit rates.