• Journal of the Korea Computer Graphics Society
• /
• v.24 no.5
• /
• pp.41-48
• /
• 2018

The most natural way to increase immersion and provide free interaction in a virtual environment is to provide a gesture interface using the user's hand. However, most studies about hand gesture recognition require specialized sensors or equipment, or show low recognition rates. This paper proposes a three-dimensional DenseNet Convolutional Neural Network that enables recognition of hand gestures with no sensors or equipment other than an RGB camera for hand gesture input and introduces a virtual reality game based on it. Experimental results on 4 static hand gestures and 6 dynamic hand gestures showed that they could be used as real-time user interfaces for virtual reality games with an average recognition rate of 94.2% at 50ms. Results of this research can be used as a hand gesture interface not only for games but also for education, medicine, and shopping.

• Proceedings of the KIEE Conference
• /
• 2003.11b
• /
• pp.103-106
• /
• 2003

In this paper, we present a hybrid inertial and vision-based tracking system for VR applications. One of the most important aspects of VR (Virtual Reality) is providing a correspondence between the physical and virtual world. As a result, accurate and real-time tracking of an object's position and orientation is a prerequisite for many applications in the Virtual Environments. Pure vision-based tracking has low jitter and high accuracy but cannot guarantee real-time pose recovery under all circumstances. Pure inertial tracking has high update rates and full 6DOF recovery but lacks long-term stability due to sensor noise. In order to overcome the individual drawbacks and to build better tracking system, we introduce the fusion of vision-based and inertial tracking. Sensor fusion makes the proposal tracking system robust, fast, accurate, and low jitter and noise. Hybrid tracking is implemented with Kalman Filter that operates in a predictor-corrector manner. Combining bluetooth serial communication module gives the system a full mobility and makes the system affordable, lightweight energy-efficient. and practical. Full 6DOF recovery and the full mobility of proposal system enable the user to interact with mobile device like PDA and provide the user with natural interface.

• Journal of the HCI Society of Korea
• /
• v.3 no.1
• /
• pp.49-56
• /
• 2008

Most recent mobile devices can store a massive amount of images. However, the typical user interface of mobile devices, such as a small-size 2D display and discrete-input buttons, make the browsing and manipulation of images cumbersome and time-consuming. As an alternative, we adopt motion-based interaction along with a 3D layout of images, expecting such an intuitive and natural interaction may facilitate the tasks. We designed and implemented a motion-based interaction scheme for image browsing using an ultra mobile PC, and evaluated and compared its usability to that of the traditional button-based interaction. The effects of data layouts (tiled and fisheye cylindrical layouts) were also investigated to see whether they can enhance the effectiveness of the motion based interaction.

• Convergence Security Journal
• /
• v.19 no.4
• /
• pp.189-195
• /
• 2019

PPL advertising is growing due to the cheaper cost than other TV commercials, the familiar image construction from natural exposure in video, and the overseas marketing effects from programs export. However, it is difficult to provide additional information on PPL advertising targets in addition to short video exposure due to the restriction that they should be exposed without antagonizing viewers. This study designed a data service that supports PPL advertising, which provides additional information for PPL advertising targets. Specifically, the user scenario and user interface of the data service were designed considering the characteristics of the TV platform, the key additional information was defined by distinguishing the typical types of PPL advertisement, and the information on when PPL advertising targets should be exposed in the program was devised. We also developed a DVB-SI based method to provide the supplementary information to the data service.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.14 no.1
• /
• pp.265-273
• /
• 2014

In this paper, context-aware technologies using a Kinect sensor for a digital signage which is increasingly growing as the 4th screen media is presented. Generalized context-aware functions for a digital signage were studied and a context-aware digital signage platform was developed. It can support a natural user interface for controlling a digital signage and actively provide contents adapted to its context. As a basic context, user's gesture and voice, the number of users, sound direction were considered. In the future, the advanced functions such as age, gender will be studied. The implemented platform could be a good reference model when developing a general context-aware digital signage.

• Speech Sciences
• /
• v.11 no.2
• /
• pp.181-192
• /
• 2004

This paper presents an efficient speech interactive agent rendering smooth car navigation and Telematics services, by employing embedded automatic speech recognition (ASR), distributed speech recognition (DSR) and text-to-speech (ITS) modules, all while enabling safe driving. A speech interactive agent is essentially a conversational tool providing command and control functions to drivers such' as enabling navigation task, audio/video manipulation, and E-commerce services through natural voice/response interactions between user and interface. While the benefits of automatic speech recognition and speech synthesizer have become well known, involved hardware resources are often limited and internal communication protocols are complex to achieve real time responses. As a result, performance degradation always exists in the embedded H/W system. To implement the speech interactive agent to accommodate the demands of user commands in real time, we propose to optimize the hardware dependent architectural codes for speed-up. In particular, we propose to provide a composite solution through memory reconfiguration and efficient arithmetic operation conversion, as well as invoking an effective out-of-vocabulary rejection algorithm, all made suitable for system operation under limited resources.

• Journal of Korean Port Research
• /
• v.13 no.2
• /
• pp.189-198
• /
• 1999

The purpose of this paper is to develop a knowledge-based real-time decision support system to support decision makers for efficient berth operation of Inchon Port. In these days the berth operation problems have been many studied. The berth operation rules differ from port to port and the problem is highly dependent on natural geographical and operational environment of port. In Inchon Port the ship’s entrance into port and departure from port is extremely affected status of dock. In this paper we analyzed some effects of dock a specific character of Inchon Port with a real data of ship’s in Inchon Port. And reconstruct a previous expert’s knowledge of berth allocating problem in Inchon Port. Also the mechanism for the efficient berth operation has been studied by repeatedly dispatching in order to obtain a best effect of berth allocation, with real-time updated information for delay at service time of a specific berth and changing of a working-berth. The system is developed with graphic user interface(GUI) concept using user interactive approach. And this system will be provide decision support maker with an efficient and fast way to berth allocating and reduce wastes of time space and manpower in Inchon Port operation.

• International Journal of Advanced Culture Technology
• /
• v.9 no.4
• /
• pp.329-344
• /
• 2021

AI assistant, a software interface designed to interact with a user in a natural way and perform specific tasks on the user's behalf, receives increasing attention from both scholars and practitioners. While most of the literatures explain about technical aspects, little is known about the social and psychological factors that intimately influence consumers when using it. This study sheds light on the reason people use AI assistant and how perceived values influence on intention of continuous usage. A total of 361 AI assistant users participated in an online survey, and all were recruited from a major online panel in South Korea. The results from the principal component analysis suggest five social and psychological motives: self-expression, quality of life, entertainment, information, and compatibility. In addition, perceived values, informativeness, entertainment, and trustworthiness, positively predict the intention to use AI assistant. This research provides theoretical contributions from finding motivations of AI assistant usage and from the effects of perceived values on the intention to use it. Practical implications should not be overlooked in this ever-expanding AI industry.

• Journal of Korea Multimedia Society
• /
• v.25 no.4
• /
• pp.649-659
• /
• 2022

The most important factor in pre-school children's psychological perception is ease of learning, and the closest measure is "natural" interaction. This study aims to explore the potential of tangible user interfaces (TUI) for AR collaboration for children's cognitive development. The conceptual model is constructed by analyzing physical interaction, spatial perception and social collaboration on the usability of TUI, to explore the role of TUI in pre-school children's cognition. In the empirical study, children aged 3-6 were taken as research objects. The experimental tool is "Plugo" education application. Parents answered questionnaires after observing their children's use. Research shows that physical interaction are the most critical factor in TUI. TUI is beneficial to the cultivation of spatial ability. The results are as follows: 1. Cronbach's Alpha and KMO were 0.921 and 0.965, which were significant and passed the reliability and validity test. 2. Through confirmatory factor analysis (model fit index, combinatorial validity), we found that physical interaction were closely related to usability. 3. The path analysis of the relationship proves that usability has a significant impact on the cultivation of pre-school children's spatial ability.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.01a
• /
• pp.77-82
• /
• 2022

GUI(Graphical User Interface)를 대신하는 차세대 인터페이스로서 NUI(Natural User Interace)에 기대가 모이는 것은 자연스러운 흐름이다. 본 연구는 NUI의 손가락 관절을 포함한 손동작 전체를 인식시키기 위해 웹캠과 카메라를 활용하여 다양한 배경과 각도의 손동작 데이터를 수집한다. 수집된 데이터는 전처리를 거쳐 데이터셋을 구축하며, ResNet50 모델을 활용하여 전이학습한 합성곱 신경망(Convolutional Neural Network) 알고리즘 분류기를 설계한다. 구축한 데이터셋을 입력시켜 분류학습 및 예측을 진행하며, 실시간 영상에서 인식되는 손동작을 설계한 모델에 입력시켜 나온 결과를 통해 가위바위보 게임을 구현한다.