• Journal of the Semiconductor & Display Technology
• /
• v.22 no.4
• /
• pp.172-178
• /
• 2023

With the expansion of metaverse content and hardware platforms, various interactions in the virtual world have been built, raising expectations for an increase in immersion which is a major element of the metaverse. However, among hardware platforms that increase virtual immersion elements, the typical HMD platform can be a barrier to new user inflows due to its high cost. Thus, this paper focused on improving virtual-to-real interactions by extracting motion data using relatively inexpensive webcam equipment in PC environments, utilizing Unity game engines, Photon unity network, multi-platform implementations, and Barracuda neural network inference libraries.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.39 no.3
• /
• pp.62-78
• /
• 2002

In this paper, we describe a system that can interact with agents in the virtual space incorporated in the system. This system is constructed by an analysis system for analyzing human gesture and an interact system for interacting with agents in the virtual space using analyzed information. An implemented analysis system for analyzing gesture extracts a head and hands region after taking image sequence of an operator's continuous behavior using CCD cameras. In interact system, we construct the virtual space that exist an avatar which incarnating operator himself, an autonomous object (like a Puppy), and non-autonomous objects which are table, door, window and object. Recognized gesture is transmitted to the avatar in the virtual space, then transit to next state based on state transition diagram. State transition diagram is represented in a graph in which each state represented as node and connect with link. In the virtual space, the agent link an avatar can open and close a window and a door, grab or move an object like a ball, order a puppy to do and respond to the Puppy's behavior as does the puppy.

• Journal of Electrical Engineering and Technology
• /
• v.9 no.2
• /
• pp.762-770
• /
• 2014

Tangible Space Initiative (TSI) is a new framework that can provide a more natural and intuitive Human Computer Interface for users. This is composed of three cooperative components: a Tangible Interface, Responsive Cyber Space, and Tangible Agent. In this paper we present a Tangible Tele-Meeting system in TSI, which allows people to communicate with each other without any spatial limitation. In addition, we introduce a method for registering a Tangible Avatar with a Tangible Agent. The suggested method is based on relative pose estimation between the user and the Tangible Agent. Experimental results show that the user can experience an interaction environment that is more natural and intelligent than that provided by conventional tele-meeting systems.

• The Journal of the Korea Contents Association
• /
• v.5 no.4
• /
• pp.122-132
• /
• 2005

CVE(Collaborative Virtual Environment) is the virtually shared area where people cannot come together physically, but wish to discuss, collaborate on, or even dispute certain matters. In CVEs, in habitants are usually represented by humanoid embodiments, generally referred to as avatars. But most current graphical CVE systems fail to reflect the natural relationship between the avatar's gesture and the conversation that is taking place. More than 65% of the information exchanged during a person to person conversation is carried on the nonverbal band. Therefore, it is expected to be beneficial to provide such communication channels in CVEs in some way. To address this issue, this study proposes a scheme to represent avatar's gestures that can support the CVE users' communication. In the first level, this study classifies the non-verbal communication forms that can be applicable to avatar gesture design. In the second level, this study categorizes the body language according to the types of interaction with verbal language. And in the third level, this study examines gestures with relevant verbal expressions according to the body parts-from head to feet. One bodily gesture can be analyzed in the description of gesture representation, the meaning of gesture and the possible expressions, which can be used in gestural situation.

• Journal of Intelligence and Information Systems
• /
• v.16 no.3
• /
• pp.37-54
• /
• 2010

The information system that preserves and presents information collections, records, processes, retrievals, is applied in various fields recently and is supporting man's many activities. Conventional information systems are based on the reactive interaction model. Such reactive systems respond to only specific instructions, i.e. the defined commands, from the user. To go beyond the reactive interaction, it is necessary that the interactive dynamic interaction based information system which understands human's action and intention autonomously and then provides sensible information adapted to the user. Therefore, we propose a Gaze Mirroring-based intelligent information system for making user's latent interest using the internal state estimation methods based on the interactive dynamic interaction. Then, the proposed Gaze Mirroring method is that an anthropomorphic agent(avatar) actively established the joint attention with the user by imitating user's eye-gaze behavior. We verify that the Gaze Mirroring can elicit the user's behavior reflecting the latent interestand contribute to improving the accuracy of interest estimation. We also have confidence that the Gaze Mirroring promotes the self-awareness of interest. Such a Gaze Mirroring-based intelligent information system also provides suitable information to user by making user's latent interest using the internal state estimation.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1997.11a
• /
• pp.134-139
• /
• 1997

가상 현실 세계에서 정보교류의 수단으로 자신의 정보를 제공하거나 또다른 정보를 수집하는 등의 정보교류와 자신을 표현하고자 하는데에 기존의 2차원의 캐릭터보다는 3차원의 캐릭터를 이용하여 사용자의 대리인으로 분신(Avatar)을 사용하는 3차원 영상을 주제로 하는 많을 연구들이 진행되고 있다. 본 연구에서는 가상현실 세계에서의 분신이 좀 더 현실감이 있는 자연스러운 행동과 상호작용을 보이기 위해서 사람 모습을 닮은 분신을 연구하였으며, 실세계의 자연스러운 정보들(손 동작, 몸 동작)을 분신에 적용하여 가상세계에서 분신의 행동양식과 상호작용이 가능하고 시각, 청각, 역각등의 다중형태의 정보들을 3차원으로 제공하고자 하는데 중점을 두었다. 이 시스템은 가상세계에서 분신을 생성하며 몇가지의 기본 행동을 가지고 간단한 방법과 실시간으로 분신의 움직임을 처리 할 수 있는 분신의 행동양식과 상호작용이 가능한 하가지 시스템을 소개할 것이다. 또한 이 시스템은 다른 기종의 플랫폼(PC, W/S)간에 다중참여자를 위하여 네트윅 환경하에서 실행 될 수 있다.

• The Journal of the Korea Contents Association
• /
• v.20 no.2
• /
• pp.581-593
• /
• 2020

The purpose of this study was to examine the eye-fixation times on different parts of a student avatar and the virtual presence with two scenarios in the virtual reality-based teaching simulation. This study was to identify user attention while he or she is interacting with a student avatar. By examining where a user is gazing during a conversation with the avatar, we have a better understanding of non-verbal communication. For this study, forty-five college students (21 females and 24 males) participated in the experiment. They had a conversation with a student avatar in a virtual reality-based teaching simulation. The participants had verbal interactions with the student avatar with two scenarios. While they were having a conversation with the virtual character in the teaching simulation, their eye-movements were collected through a head-mounted display with an eye-tracking function embedded. The results revealed that there were significant differences in eye-fixation times. Participants gazed a longer time on facial expression than any other area. The fixation time on the facial expression was more prolonged than on gestures (F=3.75, p<.05). However, the virtual presence was not significantly different in two scenario levels. This result suggested that users focus on the face more than the gesture when they emotionally interact with the virtual character.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.1
• /
• pp.419-425
• /
• 2024

As digital communication gains prominence, there is an increasing trend in uncivil behaviors like rude or hateful comments and the empathetic actions towards them, highlighting the need for social efforts to address these issues. As part of these endeavors, we investigated how avatar feedback in a virtual news portal affects users' empathy towards uncivil comments. We defined both posting and empathizing with uncivil comments as antisocial actions. To this end, we posted socially controversial news in a virtual space and provided feedback in two forms when participants selected uncivil comments: text-only feedback and feedback accompanied by an avatar. We then assessed the impact of this feedback on behavioral conformity, guilt, and self-image concern through surveys. Our results showed that avatar-provided feedback significantly influenced participants' social responses more than text-based feedback. Interaction with avatars notably increased participants' behavioral conformity, guilt, and self-image concern. We concluded that avatar-based interactions can positively influence users' social behaviors and attitudes, suggesting their potential in fostering a more civil and responsible digital communication culture.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.12
• /
• pp.8563-8567
• /
• 2015

We propose a human-robot interaction(HRI) platform based on motion capture and mapping. Platform consists of capture, processing/mapping, and action parts. A motion capture sensor, computer, and avatar and/or physical robots are selected as capture, processing/mapping, and action part(s), respectively. Case studies-an interactive presentation and LEGO robot car are presented to show the design and implementation process of Kinect based HRI platform.

• Journal of the Society of Disaster Information
• /
• v.18 no.3
• /
• pp.487-494
• /
• 2022

Purpose: This study proposes a Metaverse-based police education and training model that can efficiently improve the performance of various police activities according to changes in the environment of the times. Method: The structure of this system can generate Avatar Controller expressed using HMD and haptic technology, access the Network Interface, and educate and train individually or on a team basis through the command control module, education and training content module, and analysis module. Result: In the proposed model of this study, the command and control module was incorporated into individual or team-based education and training, enabling organic collaborative training among team members by monitoring the overall situation of terrorism or crime in real time. Conclusion: Metaverses-based individual or team-based police education and training can provide a more efficient and safe education and training environment based on immersion, interaction, and rapid judgment in various situations.