• Journal of Korean Society for Quality Management
• /
• v.49 no.3
• /
• pp.405-420
• /
• 2021

Purpose: This study started with the question of how to use Virtual Reality (VR) contents as a part of the non-face-to-face education tool that has recently attracted attention. Methods: In this paper, the use of VR contents as an educational tool is explained as a process of 'new media access dimension'. The question was explored on why Virtual Reality (or Augmented Reality) contents are not used as educational tools in the educational field. Results: As a result, the lack of 'material access' such as devices and infrastructure affects 'motivational access' approach stage, which is the previous stage. Again, it has a negative effect on literacy, which is 'skill access' approach stage. As it was found that it was not circulating to the level of "motive-material-skill-usage", it was discussed that it was taking a different step from the past adoption process of ICT and smart media. Conclusion: Based on this, it is believed that immersive content will contribute to arousing interest that can be applied and spread in the educational field, and it is also thought that it will be possible to derive academic interest in the educational effect according to the characteristics of immersive content such as VR.

• KIPS Transactions on Software and Data Engineering
• /
• v.9 no.3
• /
• pp.109-122
• /
• 2020

In recent, projection mapping, which has attracted high attention in the field of realistic media, is regarded as a technology to increase the users' immersion. However, most existing methods perform projection mapping on static objects. In this paper, we developed a technology to track the movements of users and dynamically map the media contents to the users' bodies. The projected media content is built by predefined gestures just using the user's bare hands without the special devices. An interactive immersive media system has been implemented by integrating these dynamic projection mapping technologies and gesture-based drawing technologies. The proposed realistic media system recognizes the movements and open / closed states of the user 's hands, selects the functions necessary to draw a picture. The users can freely draw the picture by changing the color of the brush using the colors of any real objects. In addition, the user's drawing is dynamically projected on the user's body, allowing the user to design and wear his t-shirt in real-time.

• Journal of Broadcast Engineering
• /
• v.28 no.2
• /
• pp.213-229
• /
• 2023

In this paper, we introduce a spatial sound rendering system that provides 6DoF spatial sound in real time in response to the movement of a listener located in a virtual environment. This system was implemented using MPEG-I AEP as a development environment for the CfP response of MPEG-I Immersive Audio and consists of an encoder and a renderer including a decoder. The encoder serves to offline encode metadata such as the spatial audio parameters of the virtual space scene included in EIF and the directivity information of the sound source provided in the SOFA file and deliver them to the bitstream. The renderer receives the transmitted bitstream and performs 6DoF spatial sound rendering in real time according to the position of the listener. The main spatial sound processing technologies applied to the rendering system include sound source effect and obstacle effect, and other ones for the system processing include Doppler effect, sound field effect and etc. The results of self-subjective evaluation of the developed system are introduced.

• Proceedings of the IEEK Conference
• /
• 2003.11b
• /
• pp.107-110
• /
• 2003

In this paper, we propose sharing 3D media between multisite using enhanced Access Grid (e-AG) which is a composition of 3D display and Access Grld (AG) Conventional AG and other collaborative systems have a limitation to share immersive 3D media Thus, proposed system supports sharing 3D media contents in a AG meeting section. Real object can be shared by acquiring stereo image with pre-calibrated stereo camera and by delivering, and virtual object can be shared by transmitting state information after downloading 3D model. And also, real video scene acquired by stereo camera and virtual object from 3D model can be displayed on the 3D display system of each node adaptively. The characteristics of proposed sharing method are sharing 3D media, displaying 3D media on a system adaptively, supporting real-time interaction. The proposed sharing method will be used remote lecture, remote collaboration with 3D media.

• Journal of the Optical Society of Korea
• /
• v.18 no.1
• /
• pp.32-36
• /
• 2014

A tangible floating display that can provide different perspective views without special glasses being introduced. The proposed system can display perspective floating images in the space in front of the system with the help of concave mirrors. In order to avoid wearing special equipment to interact and deliver the sense of touch, the proposed system adopted an ultrasound focusing technology. For providing an immersive experience to the viewers, the proposed system consists of a tangible floating display system and a multiple-view imaging system for generating three lenticular displays in front of the users.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.286-287
• /
• 2020

Depth map is the most common way of expressing 3D space in immersive media. In this paper, we propose a post-processing method to improve the quality of depth map. In proposed method, a depth map is divided into segments, and the plane of each segment estimated using RANSAC. In order to increase the accuracy of the RANSAC process, we apply matching reliability of each pixel in depth map as a weighting factor.

• Smart Media Journal
• /
• v.11 no.9
• /
• pp.75-80
• /
• 2022

Recently, research and development on immersive virtual reality(VR) technology to provide a realistic experience is being widely conducted. To provide realistic experience in immersive virtual reality for VR participants, virtual environments should consist of high-realistic environments using 3D reconstruction. In this paper, to acquire 3D information in real space using multiple cameras in the reconstruction process, we propose a novel method of optimal camera placement for accurate reconstruction to minimize distortion of 3D information. Through our approach in this paper, real 3D information can obtain with minimized errors during environment reconstruction, and it is possible to provide a more immersive experience with the created virtual environment.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2022.06a
• /
• pp.253-256
• /
• 2022

실사 영상 기반의 메타버스 환경을 구축하기 위한 다수의 카메라를 통한 영상 취득 및 부호화, 전송 기술이 활발히 연구되고 있고, 이를 위해 영상 압축 표준화 단체인 moving picture experts group (MPEG) 에서는 MPEG immersive video (MIV) 표준을 개발하였다. 하지만, 현재 널리 사용되는 가상 현실 영상을 스트리밍 가능한 장비의 연산 능력으로는 MIV 기반 몰입형 영상을 스트리밍 시 복호기 동기화 문제가 발생할 수 있다. 따라서 본 논문은 저사양 및 고사양 장비에서 적응적으로 복호기 개수를 조절 가능한 geometry packing 기법을 MIV 의 참조 소프트웨어인 test model for immersive video (TMIV)에서 구현한다. 제안하는 패킹 기법은 지오메트리 영상을 패킹하여 텍스쳐 영상과 같은 높이를 가지도록 한 후 각각 단일 서브픽쳐 (subpicture) 로 부호화한다. 이후 부호화된 서브픽쳐들에 적응적으로 비트스트림 병합이 적용되어 장비의 복호기 사양에 대응한다.

• ETRI Journal
• /
• v.44 no.1
• /
• pp.38-50
• /
• 2022

This paper presents a study on the use of encoder-derived features in decoder-side depth estimation. The scheme of multiview video encoding does not require the transmission of depth maps (which carry the geometry of a three-dimensional scene) as only a set of input views and their parameters are compressed and packed into the bitstream, with a set of features that could make it easier to estimate geometry in the decoder. The paper proposes novel recursive block splitting for the feature extraction process and evaluates different scenarios of feature-driven decoder-side depth estimation, performed by assessing their influence on the bitrate of metadata, quality of the reconstructed video, and time of depth estimation. As efficient encoding of multiview sequences became one of the main scopes of the video encoding community, the experimental results are based on the "geometry absent" profile from the incoming MPEG Immersive video standard. The results show that the quality of synthesized views using the proposed recursive block splitting outperforms that of the state-of-the-art approach.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2022.06a
• /
• pp.1213-1215
• /
• 2022

몰입형 비디오 부호화를 위한 MIV(MPEG Immersive Video) 표준은 제한된 3D 공간의 다양한 위치의 뷰(view)들을 효율적으로 압축하여 사용자에게 임의의 위치 및 방향에 대한 6 자유도(6DoF)의 몰입감을 제공한다. MIV 의 참조 소프트웨어인 TMIV(Test Model for Immersive Video)에서는 복수의 뷰 간 중복되는 영역을 제거하여 전송할 화소수를 줄이기 때문에 복호화기에서 렌더링(rendering)을 위해서 각 화소의 점유(occupancy) 정보도 전송되어야 한다. TMIV 는 점유맵을 깊이(depth) 아틀라스(atlas)에 포함하여 압축 전송하고, 부호화 오류로 인한 점유 정보 손실을 방지하기 위해 깊이값 표현을 위한 동적 범위의 일부를 보호대역(guard band)으로 할당한다. 이 보호대역을 줄여서 더 넓은 깊이값의 동적 범위를 사용하면 렌더링 화질을 개선시킬 수 있다. 따라서, 본 논문에서는 현재 TMIV 의 점유 정보 오류 분석을 바탕으로 이를 보정하는 기법을 제시하고, 깊이 동적 범위 확장에 따른 부호화 성능을 분석한다. 제안기법은 기존의 TMIV 와 비교하여 평균 1.3%의 BD-rate 성능 향상을 보여준다.