• Journal of Broadcast Engineering
• /
• v.27 no.5
• /
• pp.654-664
• /
• 2022

Immersive content overcomes spatial limitations through convergence with extended reality, artificial intelligence, and photogrammetry technology along with interest due to the COVID-19 pandemic, presenting a new paradigm in the content market such as entertainment, media, performances, and exhibitions. However, it can be seen that in order for realistic content to have sustained public interest, it is necessary to study storytelling method that can increase immersion in content rather than technological freshness. Therefore, in this study, we propose a immersive content storytelling method using artificial intelligence and photogrammetry technology. The proposed storytelling method is to create a content story through interaction between interactive virtual beings and participants. In this way, participation can increase content immersion. This study is expected to help content creators in the accelerating immersive content market with a storytelling methodology through virtual existence that utilizes artificial intelligence technology proposed to content creators to help in efficient content creation. In addition, I think that it will contribute to the establishment of a immersive content production pipeline using artificial intelligence and photogrammetry technology in content production.

• Journal of Broadcast Engineering
• /
• v.27 no.6
• /
• pp.848-859
• /
• 2022

This paper presents a novel 360-degree video streaming system for large-scale immersive displays and its ongoing implementation. Recent VR systems aim to provide a service for a single viewer on HMD. However, the proposed 360-degree video streaming system enables multiple viewers to explore immersive contents on a large-scale immersive display. The proposed 360-degree video streaming system is being developed in 3 research phases, with the final goal of providing 6DoF. Currently, the phase 1: implementation of the 3DoF 360-degree video streaming system prototype is finished. The implemented prototype employs subpicture-based viewport-dependent streaming technique, and it achieved bit-rate saving of about 80% and decoding speed up of 543% compared to the conventional viewport-independent streaming technique. Additionally, this paper demonstrated the implemented prototype on UCSB AlloSphere, the large-scale instrument for immersive media art exhibition.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.71-79
• /
• 2024

This study organizes an immersive content production pipeline using Meta Quest Pro as an asymmetric virtual environment where mixed reality(MR) and virtual reality(VR) users participate and interact together. Based on this, we compare and analyze the differences in presence and experience provided by the user's experience environment. The proposed production process is to build an integrated development environment using Meta XR All-in-One SDK based on the Unity 3D engine. This includes a real space analysis method using the Room Model function for organic and accurate interaction between MR users in the real world and VR users based on virtual scenes at fixed coordinates. Based on this, this study produces immersive table tennis content where MR and VR users participate together. Finally, we conduct survey experiments to compare and analyze the effects of differences in platform and participation methods on presence and experience using the produced content. As a result, this study confirmed that all users can feel a satisfactory presence and experience within an experience environment where real and virtual correspond.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2018.07a
• /
• pp.76-77
• /
• 2018

본 논문에서는 재미있는 게임을 제작하기 위해 사용자 몰입을 극대화 할 수 있는 장치를 분석하고 이 가운데 청각적인 요소를 집중적으로 활용한 게임 디자인에 대해 소개하고자 한다. 암흑의 공간에서 긴장감을 조성하고 다양한 오브젝트들의 특성을 반영한 사운드를 이용하여 게임월드를 탐험하도록 설계하였고 이를 구현하였다. 본 게임은 사용자 몰입을 위한 게임 설계에 좋은 가이드라인이 될 것으로 기대한다.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.11 no.4
• /
• pp.414-420
• /
• 2018

The digital convergence looking for new ways to engage visitors by superimposing virtual content on projection over the real world captured media contents. This paper propose the Light ID based interactive 3D immersive exhibition things view using HMD AR technology. This approach does not required to add any additional infrastructure to be built-in to enable service and uses the installed Lighting or displays devices in the exhibit area. In this approach, the Light ID can be used as a Location Identifier and communication medium to access the content unlike the QR Tag which supports provide the download information through web interface. This utilize the advantages of camera based optical wireless communication (OWC) to receive the media content on smart device to deliver immersive 3D content visualization using AR. The proposed exhibition method is emulated on GALAXY S8 smart phone and the visual performance is evaluated for Jeonju Hanok Village. The experimental results shows that the proposed method can give immersive 3D view for exhibit things in real-time.

• Journal of the Korea Computer Graphics Society
• /
• v.29 no.3
• /
• pp.69-77
• /
• 2023

This study proposes a rigid-body tracking based virtual avatar application method to increase the social presence and provide various experiences of virtual reality(VR) users in an immersive virtual environment. The proposed method estimates the motion of a virtual avatar through inverse kinematics based on real-time rigid-body tracking based on motion capture using markers. Through this, it aims to design a highly immersive virtual environment with simple object manipulation in the real world. Science experiment educational contents are produced to experiment and analyze applications related to immersive virtual environments through virtual avatars. In addition, audiovisual education, full-body tracking, and the proposed rigid-body tracking method were compared and analyzed through survey. In the proposed virtual environment, participants wore VR HMDs and conducted a survey to confirm immersion and educational effects from virtual avatars performing experimental educational actions from estimated motions. As a result, through the method of utilizing virtual avatars based on rigid-body tracking, it was possible to induce higher immersion and educational effects than traditional audiovisual education. In addition, it was confirmed that a sufficiently positive experience can be provided without much work for full-body tracking.

• Journal of the Korea Computer Graphics Society
• /
• v.29 no.4
• /
• pp.1-6
• /
• 2023

To enhance immersive experiences for metaverse environements, background music is often used. However, the background music is mostly pre-matched and repeated which might occur a distractive experience to users as it does not align well with rapidly changing user-interactive contents. Thus, we implemented a system to provide a more immersive metaverse conversation experience by 1) developing a regression neural network that extracts emotions from an utterance using KEMDy20, the Korean multimodal emotion dataset 2) selecting music corresponding to the extracted emotions from an utterance by the DEAM dataset where music is tagged with arousal-valence levels 3) combining it with a virtual space where users can have a real-time conversation with avatars.

• 한국HCI학회:학술대회논문집
• /
• 2008.02c
• /
• pp.6-11
• /
• 2008

The more technologies of multimedia are developed and multimodal interactions are proposed, the more people expect immersive interactions. This paper presents a enhanced moyie system which provides viewers with passive haptic sensation synchronized with audiovisual media. Also, we discuss the potential haptic contents in a movie system and the characteristics of effective authoring tool generating various haptic contents for various scenes. Furthermore, an example of enhanced haptic movie system is discussed and the first version of our haptic authoring tool for creating haptic contents of a movie system is introduced.

• Journal of Korea Game Society
• /
• v.21 no.3
• /
• pp.147-156
• /
• 2021

In this paper, we planned to see the positive effects of the immersive virtual environment. In particular, the positive effect of presence on physical performance was explored. A total of 25 participants were recruited for this experiment and his/her physical performance was measured by Electromyography (EMG) while they were exercising (rowing), and presence was measured by a self-reported measure. The participants were randomly assigned to experience either a) Virtual Reality (VR) or b) non-VR (2D screen) condition when they played the exergame. The result showed that 1) there was a positive relationship between representation mode and presence and 2) the higher level of presence reinforced the user's physical performance. The limitation of the study and future study were also discussed.

• Journal of Korea Multimedia Society
• /
• v.24 no.11
• /
• pp.1560-1566
• /
• 2021

Cyber Sickness, which occurs when using Virtual Reality contents, is the most serious problem in immersive Virtual Reality contents. The purpose of this study is to identify the effects and causes of graphic environmental factors on Cyber Sickness in Virtual Reality contents. To this end, cyber sickness experiments were conducted according to the light source and material settings, which are most commonly used in graphical environmental elements. Cyber Sickness measurements were based on the Simulator Sickness Question(SSQ) tool to derive an index that causes Cyber Sickness As a result of the analysis, the smaller the surface roughness, the higher the degree of Cyber Sickness, and the smaller the surface roughness, the smoother the surface of the 3D object, and many specular reflections from the light source occurred, which was confirmed to be the cause of great Cyber Sickness.