• Journal of Broadcast Engineering
• /
• v.14 no.5
• /
• pp.616-624
• /
• 2009

This paper presents a 3D stereoscopic TIP (Tour Into Picture) for Korean classical paintings being composed of persons, boat, and landscape. Unlike conventional TIP methods providing 2D image or video, our proposed TIP can provide users with 3D stereoscopic contents. Navigating a picture with stereoscopic viewing can deliver more realistic and immersive perception. The method firstly makes input data being composed of foreground mask, background image, and depth map. The second step is to navigate the picture and to obtain rendered images by orthographic or perspective projection. Then, two depth enhancement schemes such as depth template and Laws depth are utilized in order to reduce a cardboard effect and thus to enhance 3D perceived depth of the foreground objects. In experiments, the proposed method was tested on 'Danopungjun' and 'Muyigido' that are famous paintings made in Chosun Dynasty. The stereoscopic animation was proved to deliver new 3D perception compared with 2D video.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.06a
• /
• pp.228-230
• /
• 2016

In this paper, we introduce new FRUC method for Multi-View Video based on DIBR (Depth Image based Rendering, DIBR). In the proposed method, we divide each block to sub-regions using depth map. Then, we reconstruct occlusion region information at each sub-regions by using other views. With reconstructed occlusion region information, we estimate and compensate each sub-regions' motion. The proposed method estimates more accurate motion compared to the conventional methods in occlusion region.

• Journal of the Korea Computer Graphics Society
• /
• v.9 no.4
• /
• pp.1-7
• /
• 2003

본 논문에서는 GPU와 스텐실 버퍼(stencil buffer) 및 깊이 버퍼(depth buffer)를 이용하여 가려진 픽셀들을 렌더링 단계 이전에 건너뛰는(skipping) 방법을 제시하고자 한다. 그래픽 카드에 기본적으로 제공되는 기능인 깊이 및 스텐실 버퍼 검사(depth & stencil buffer test)를 이용하여 이진 차폐 맵(binary occlusion map)을 만들고 이를 재사용하여 가려지는 부분의 픽셀들을 효과적으로 건너뛰게 하는 방법이다. 전체 볼륨 데이터는 팔진트리(octree) 구조를 가진 서브볼륨들로 나뉘어 저장되며 시점에 가까운 서브볼륨부터 렌더링에 사용된다. 서브볼륨들을 차례로 렌더링하면서 차폐 맵을 갱신하게 하면, 멀리 있는 서브볼륨들을 렌더링할 때 이미 가려진 픽셀들을 렌더링에서 제외할 수 있다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2005.11a
• /
• pp.1407-1410
• /
• 2005

반투명 물체(Translucent Object)는 불투명한 물체와는 달리 물체 내부에서 산란이 일어난다. 따라서 반투명 물체의 한 표면(Surface)을 렌더링하기 위해서는 그 표면의 정규 벡터뿐만 아니라 그 표면의 주변 기하 정보가 필요하다. 그러나 그래픽 하드웨어 구조는 불투명한 표면의 렌더링에만 적합하게 설계 되었기 때문에, 반투명 물체의 실시간 렌더링의 구현에는 많은 제약이 따른다. 이 논문에서는 영상 공간 접근 방법(Image Space Approach)의 연장선에서 기존의 방법론이 가지고 있는 한계점을 해결함으로써, 반투명 재질의 실시간 렌더링을 위한 효과적인 방법을 제시한다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.2
• /
• pp.438-446
• /
• 2013

Generally, a camera isn't located at the center of display in a tele-presence system and it causes an incorrect eye contact between speakers which reduce the realistic feeling during the conversation. To solve this incorrect eye contact problem, we newly propose an intermediate view reconstruction algorithm using both a color camera and a depth camera and applying for the depth image based rendering (DIBR) algorithm. In the proposed algorithm, an efficient hole filling method using the arithmetic mean value of neighbor pixels and an efficient boundary noise removal method by expanding the edge region of depth image are included. We show that the generated eye-contacted image has good quality through experiments.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.3
• /
• pp.51-57
• /
• 2021

In this paper, we propose a method to find the DoF(Depth of field) that is blurred in an image by focusing and out-focusing the camera through a efficient convolutional neural network. Our approach uses the RGB channel-based cross-correlation filter to efficiently classify the DoF region from the image and build data for learning in the convolutional neural network. A data pair of the training data is established between the image and the DoF weighted map. Data used for learning uses DoF weight maps extracted by cross-correlation filters, and uses the result of applying the smoothing process to increase the convergence rate in the network learning stage. The DoF weighted image obtained as the test result stably finds the DoF region in the input image. As a result, the proposed method can be used in various places such as NPR(Non-photorealistic rendering) rendering and object detection by using the DoF area as the user's ROI(Region of interest).

• Journal of Broadcast Engineering
• /
• v.21 no.6
• /
• pp.878-888
• /
• 2016

This paper proposes an efficient method to remove the boundary artifacts of rendered views caused by damaged depth maps in the 3D video system. First, characteristics of boundary artifacts with the compression noise in depth maps are carefully studied. Then, the artifacts suppression method is proposed by the iterative projection onto convex sets (POCS) algorithm with setting the convex set in pixel and frequency domain. The proposed method is applied to both texture and depth maps separately during view rendering. The simulation results show the boundary artifacts are greatly reduced with improving the quality of synthesized views.

• ETRI Journal
• /
• v.37 no.4
• /
• pp.743-751
• /
• 2015

Cloud gaming services are heavily dependent on the efficiency of real-time video streaming technology owing to the limited bandwidths of wire or wireless networks through which consecutive frame images are delivered to gamers. Video compression algorithms typically take advantage of similarities among video frame images or in a single video frame image. This paper presents a method for computing and extracting both graphics information and an object's boundary from consecutive frame images of a game application. The method will allow video compression algorithms to determine the positions and sizes of similar image blocks, which in turn, will help achieve better video compression ratios. The proposed method can be easily implemented using function call interception, a programmable graphics pipeline, and off-screen rendering. It is implemented using the most widely used Direct3D API and applied to a well-known sample application to verify its feasibility and analyze its performance. The proposed method computes various kinds of graphics information with minimal overhead.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2021.06a
• /
• pp.85-88
• /
• 2021

포인트 클라우드 콘텐츠는 실제 환경 및 물체를 3 차원 위치정보를 갖는 점들과 그에 대응하는 색상 등을 획득하여 기록한 실감 콘텐츠이다. 위치와 색상 정보로만 이뤄진 3 차원 점으로 이뤄진 포인트 클라우드 콘텐츠는 확대하여 렌더링 할 경우 점과 점 사이의 간격이 벌어지면서 발생하는 구멍에 의해 콘텐츠 품질이 저하될 수 있다. 이러한 문제를 해결하기 위해 본 논문에서는 포인트 클라우드 확대 시 점들 간 간격이 벌어져 생기는 구멍에 대해 깊이정보를 활용한 역변환 기반 보간 방법을 통해 포인트 클라우드 콘텐츠 품질을 개선하는 방법을 제안한다. 벌어진 간격들 사이에서 빈 공간을 찾을 때 그 사이로 뒷면의 점들이 그려지게 되어 보간 방법을 적용하는데 방해요소로 작용한다. 이를 해결하기 위해 구멍이 발생하지 않은 시점에서 렌더링 된 영상을 사용하여 포인트 클라우드의 뒷면에 해당되는 점들을 제거한다. 다음으로 깊이 맵(depth map)을 추출한 후 추출된 깊이 값을 사용하여 뎁스 에지(depth edge)를 구하고 에지를 사용하여 깊이 불연속 부분에 대해 처리한다. 마지막으로 뎁스 값을 활용하여 이전에 찾은 구멍들의 역변환을 하여 원본의 데이터에서 픽셀을 추출한다. 제안하는 방법으로 콘텐츠를 렌더링 한 결과, 기존의 크기를 늘려 빈 영역을 채우는 방법에 비해 렌더링 품질이 평균 PSNR 측면에서 2.9 dB 향상된 결과를 보였다.

• Journal of the Korea Computer Graphics Society
• /
• v.8 no.1
• /
• pp.29-35
• /
• 2002

In virtual endoscopy, it is important to produce high quality perspective images in real-time. However, it is more significant to devise a navigation method that can make a virtual camera move through in human cavities such as colon and bronchus without collision and let the user control the camera intuitively. We propose an efficient navigation method, which generates 2D depth map during rendering the current frame, then determines position and direction of camera using the depth information. It offers collision-free navigation and allows us to control the camera as we want. Also it does not require preprocessing step and additional data structures.