• Journal of the Korea Computer Graphics Society
• /
• v.30 no.1
• /
• pp.1-10
• /
• 2024

In immersive virtual environments including mixed reality (MR) and virtual reality (VR), avatars or agents, which are virtual humans, are being studied and applied in various ways as factors that increase users' social presence. Recently, studies are being conducted to apply generative AI as an agent to improve user learning effects or suggest a collaborative environment in an immersive virtual environment. This study proposes a novel method for interface application of a virtual assistant agent (VAA) using OpenAI's ChatGPT in an immersive virtual environment including VR and MR. The proposed method consists of an information agent that responds to user queries and a control agent that controls virtual objects and environments according to user needs. We set up a development environment that integrates the Unity 3D engine, OpenAI, and packages and development tools for user participation in MR and VR. Additionally, we set up a workflow that leads from voice input to the creation of a question query to an answer query, or a control request query to a control script. Based on this, MR and VR experience environments were produced, and experiments to confirm the performance of VAA were divided into response time of information agent and accuracy of control agent. It was confirmed that the interface application of the proposed VAA can increase efficiency in simple and repetitive tasks along with user-friendly features. We present a novel direction for the interface application of an immersive virtual environment through the proposed VAA and clarify the discovered problems and limitations so far.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.11
• /
• pp.59-65
• /
• 2020

Lately the VR (Virtual Reality) game genre is becoming increasingly more popular and it has been cementing its place in the market as its own independent game genre. The key advantage of VR is that it lowers the barrier between player and the virtual world, thus creating an immersive experience. The suggested method develops a game that allows the player to experience what it is like to be visually impaired using the unique characteristics of VR. A distinctive feature of this game is that the character is provided only a limited range of sight, which is created using silhouette outlines. This restrictive visual field is then grafted onto VR and the player can indirectly experience blindness in a highly immersive manner. The silhouette outline along with the particle system is created using Oculus Rift, a headset highly used in VR game development, and Unity 3D game engine. We will also explain in detail regarding the removal of borders between the objects.

• Cartoon and Animation Studies
• /
• s.17
• /
• pp.37-51
• /
• 2009

Immersion is the key factor in determining success or failure for fictional narrative animations. It does matter to not only for the socio-economic achievements like box-office success but to the asthetical achievement, immersion is very important prerequisite character that are raised in terms of research needs. Fictional narrative animation shares the audience's immersive method with the narrative content and Virtual Reality, since animation has the character which narrates itself with the visual image format (including sound) and added the fact that 3D format which emphasizes realism compared with the recent 2D animation has been ubiquitous phenomenon. In other words, the artistic for called 'animation' is located between the view point that text has the immersive point intrinsic and oppositely, specific function of the certain media which stays extrinsic of the text enforce the participants into the immersion. In any case, the subject who experience immersion is the audience, so the most useful theory to research the phenomenon 'immersion' is Constructivism cognitive narrotologic approach which lies the peader-spectator as the centric notion and is more useful than text analysis or research on the visual effects. In this study, research and review about the studies on the audience's immersive experience would be preceded particularly aroud the constructivism theories, and examine the uniqueness and naures of the animation which makes the audience immersive.

• Phonetics and Speech Sciences
• /
• v.15 no.3
• /
• pp.9-16
• /
• 2023

The current study investigated the influence of age of L2 acquisition (AOA) and length of residence (LOR) in the L2 setting country on the production of voicing-conditioned vowel duration and spectral qualities in English by Korean learners. The primary aim was to explore the ways in which the language-specific phonetic features are acquired by the age of onset and L2 experience. Analyses of the archived corpus data produced by 45 native speakers of Korean showed that, regardless of AOA or LOR, absolute vowel duration was used as a salient correlate of voicing contrast in English for Korean learners. The accuracy of relative vowel duration was influenced more by onset age than by L2 experience, suggesting that being exposed to English at an early age may benefit the acquisition of temporal dimension. On the other hand, the spectral characteristics of English vowels were more consistently influenced by L2 experience, indicating that immersive experience in the L2 speaking environment are likely to improve the accurate production of vowel quality. The distinct influence of the onset age and L2 experience on the specific phonetic cues in L2 vowel production provides insight into the intricate relationship between the two factors on the manifestation of L2 phonological knowledge.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.954-959
• /
• 2006

Virtual Reality simulation enables immersive 3D experience of a Virtual Environment. A simulation-based VE can be used to map real world phenomena into virtual experience. This research studies on the use of Newton's physics law to demonstrate the effects of forces upon object's falling movement, and their effects towards other fallible objects. A reconfigurable simulation enables users to reconfigure the parameters of the objects involved in the simulation, so that they can see different effects from the different configurations, such as force magnitude and distance between objects. This concept is suitable for a classroom learning of physics law. Preliminary implementation is done on a PC with a joystick for 4DOF movement. The graphics is implemented by SGI OpenGL Performer. A middleware called NAVERLib that consists of Performer's modules for easy XML-based configuration is used for management of visualization, network and devices connection, and where the engine of this domino simulation is attached.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.80-85
• /
• 2024

The concept of single-modal digital art originated in the 20th century and has evolved through three key stages. Over time, digital art has transformed into multi-modal interaction, representing a new era in art forms. Based on multi-modal theory, this paper aims to explore the characteristics of interactive digital art in innovative art forms and its impact on user experience. Through an analysis of practical application of multi-modal interactive digital art, this study summarises the impact of creative models of digital art on the physical and mental aspects of user experience. In creating audio-visual-based art, multi-modal digital art should seamlessly incorporate sensory elements and leverage computer image processing technology. Focusing on user perception, emotional expression, and cultural communication, it strives to establish an immersive environment with user experience at its core. Future research, particularly with emerging technologies like Artificial Intelligence(AR) and Virtual Reality(VR), should not merely prioritize technology but aim for meaningful interaction. Through multi-modal interaction, digital art is poised to continually innovate, offering new possibilities and expanding the realm of interactive digital art.

• Journal of the Korea Computer Graphics Society
• /
• v.29 no.3
• /
• pp.69-77
• /
• 2023

This study proposes a rigid-body tracking based virtual avatar application method to increase the social presence and provide various experiences of virtual reality(VR) users in an immersive virtual environment. The proposed method estimates the motion of a virtual avatar through inverse kinematics based on real-time rigid-body tracking based on motion capture using markers. Through this, it aims to design a highly immersive virtual environment with simple object manipulation in the real world. Science experiment educational contents are produced to experiment and analyze applications related to immersive virtual environments through virtual avatars. In addition, audiovisual education, full-body tracking, and the proposed rigid-body tracking method were compared and analyzed through survey. In the proposed virtual environment, participants wore VR HMDs and conducted a survey to confirm immersion and educational effects from virtual avatars performing experimental educational actions from estimated motions. As a result, through the method of utilizing virtual avatars based on rigid-body tracking, it was possible to induce higher immersion and educational effects than traditional audiovisual education. In addition, it was confirmed that a sufficiently positive experience can be provided without much work for full-body tracking.

• Journal of Platform Technology
• /
• v.9 no.3
• /
• pp.70-77
• /
• 2021

The purpose of Serious games in immersive Metaverse platform to provide users both fun and intriguing learning experiences. We proposes a serious game for self-trainable fire evacuation drill with collaboration among avatars synchronized with multiple trainees and optionally with real-time supervising placed at different remote physical locations. The proposed system architecture is composed of wearable motion sensors and a Head Mounted Display to synchronize each user's intended motions to her/his avatar activities in a cyberspace in Metaverse environment. The proposed system provides immersive as well as inexpensive environments for easy-to-use user interface for cyber experience-based fire evacuation training system. The proposed configuration of the user-avatar interface, the collaborative learning environment, and the evaluation system on the VR serious game are expected to be applied to other serious games. The game was implemented only for the predefined fire scenario for buildings, but the platform can extend its configuration for various disaster situations that may happen to the public.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.456-460
• /
• 2008

Digilog Book lets users feel analog book and digital contents by combining each advantage of analog sensibility and digital sensation. This paper mentions about technical details for implementing an example of Digilog book: a temple bell experience system. Our system includes providing multisensory feedback to users, substituting fiducial marker with figure marker, presenting visual effect when a temple bell appearing on a 2D plane, pushing augmented buttons using bare fingers for observation of the bell, and lastly pointing a specific part of the bell for obtaining description on that part. The implemented temple bell experience system can motivate users to experience cultural heritages of our country as educational contents.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.2
• /
• pp.159-169
• /
• 2016

In order to realize the virtual prototyping (VP) of digital products, it is important to provide the people involved in product development with the appropriate visualization and interaction of the products, and the vivid simulation of user interface (UI) behaviors in an interactive 3D virtual environment. In this paper, we propose an approach to web-based 3D virtual experience using Unity and Leap Motion. We adopt Unity as an implementation platform which easily and rapidly implements the visualization of the products and the design and simulation of their UI behaviors, and allows remote users to get an easy access to the virtual environment. Additionally, we combine Leap Motion with Unity to embody natural and immersive interaction using the user's hand gesture. Based on the proposed approach, we have developed a testbed system for web-based 3D virtual experience and applied it for the design evaluation of various digital products. Button selection test was done to investigate the quality of the interaction using Leap Motion, and a preliminary user study was also performed to show the usefulness of the proposed approach.