• The Journal of the Korea Contents Association
• /
• v.11 no.12
• /
• pp.619-628
• /
• 2011

Normally vision-based 3D human pose recognition technology is used to method for convey human gesture in HCI(Human-Computer Interaction). 2D pose model based recognition method recognizes simple 2D human pose in particular environment. On the other hand, 3D pose model which describes 3D human body skeletal structure can recognize more complex 3D pose than 2D pose model in because it can use joint angle and shape information of body part. In this paper, we describe a development of interactive game contents using pose recognition interface that using 3D human body joint information. Our system was proposed for the purpose that users can control the game contents with body motion without any additional equipment. Poses are recognized comparing current input pose and predefined pose template which is consist of 14 human body joint 3D information. We implement the game contents with the our pose recognition system and make sure about the efficiency of our proposed system. In the future, we will improve the system that can be recognized poses in various environments robustly.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.37 no.5
• /
• pp.54-63
• /
• 2000

In this paper, we implemented cyber character that can do speech recognition, speech synthesis, Motion tracking and 3D animation. For speech recognition, we used Discrete-HMM algorithm with K-means 128 level vector quantization and MFCC feature vector. For speech synthesis, we used demi-syllables TD-PSOLA algorithm. For PC based Motion tracking, we present Fast Optical Flow like Method. And for animating 3D model, we used vertex interpolation with DirectSD retained mode. Finally, we implemented cyber character integrated above systems, which game calculating by the multiplication table with user and the cyber character always look at user using of Motion tracking system.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2010.10a
• /
• pp.329-330
• /
• 2010

Classic game Pac-Man (Pacman) is playing a game using a somple hand gasture without using a keyboard or a mouse. In other words, it is a joystick game by motion to replace the arrow keys using the center coordinates of the hand. In addition, the pointer of hand is extracted by accepting images to MFC dialog using cam. Thus, movements of the monsters is to be replaced by hand movements. In this paper, smoothing, expansion, and erosion operation for the skin color extraction, and RGB images are converted to YCbCbr images.

• Journal of The Korean Association of Information Education
• /
• v.23 no.4
• /
• pp.363-374
• /
• 2019

Recently, there is an increasing interest in game based learning as a teaching method for digital native learners. This study set kinect game contributes to engaged learning as the competition and cooperation play (achievement goals, interaction), the digital game play (multisensory stimulation, fantasy and curiosity, chance, accurate feedback, control), and the body movement play (embodied cognition, presence). After performing classes using the motion recognition game developed for the elementary school history class, this study conducted semi structured interviews based on engaged learning elements of kinect game based learning for students who were successfully participating in learning. In the result, each element appeared to a successful learner. Based on these results, this study hopes to assist researchers as a basic evidence to introduce kinect game-based learning for engaged learning.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.8
• /
• pp.111-117
• /
• 2020

Recently, with the high interest of machine learning, the need for educational controllers to interface with physical devices has increased. However, existing controllers are limited in terms of high cost and area of utilization for educational purposes. In this paper, motion control controllers using brain waves are proposed for the purpose of students' machine learning applications. The brain motion that occurs when imagining a specific action is measured and sampled, then the sample values were learned through Tensor Flow and the motion was recognized in contents such as games. Movement variation for motion recognition consists of directionality and jump motion. The identification of the recognition behavior is sent to a game produced by an Unreal Engine to operate the character in the game. In addition to brain waves, the implemented controller can be used in various fields depending on the input signal and can be used for educational purposes such as machine learning applications.

• Journal of Korea Game Society
• /
• v.9 no.5
• /
• pp.105-115
• /
• 2009

This article proposes a design and implementation methodology of a gesture-based interface for augmented reality games. The topic of gesture-based augmented reality games is a promising area in the immersive future games using human body motions. However, due to the instability of the current motion recognition technologies, most previous development processes have introduced many ad hoc methods to handle the shortcomings and, hence, the game architectures have become highly irregular and inefficient This article proposes an efficient development methodology for gesture-based augmented reality games through prototyping a table tennis game with a gesture interface. We also verify the applicability of the prototyping mechanism by implementing and demonstrating the augmented reality table tennis game. In the experiments, the implemented prototype has stably tracked real rackets to allow fast movements and interactions without delay.

• Journal of Korea Game Society
• /
• v.5 no.3
• /
• pp.3-10
• /
• 2005

We present the computer table tennis game using player's swing motion. We need to transform a real world coordinate into a virtual world coordinate in order to hit the virtual ball. We can not get a correct 3-dimension position of racket in environment that using one camera or simple image processing. Therefore we use Augmented Reality (AR) concept to develop the game. This paper shows the AR table tennis game using gesture and method to develop the 3D interaction game that only using one camera without any motion detection device or stereo cameras. Also, we use a scan line method to recognize gesture for speedy processing. The game is developed using ARtoolkit and DirectX that is popular tool of SDK for game development.

• Journal of Korea Game Society
• /
• v.17 no.6
• /
• pp.113-120
• /
• 2017

With the development of virtual reality technology, in recent years, user-friendly hand gesture interface has been more studied for natural interaction with a virtual 3D object. Most earlier studies on the hand-gesture interface are using relatively simple hand gestures. In this paper, we suggest an intuitive hand gesture interface for interaction with 3D object in the virtual reality applications. For hand gesture recognition, first of all, we preprocess various hand data and classify the data through the binary decision tree. The classified data is re-sampled and converted to the chain-code, and then constructed to the hand feature data with the histograms of the chain code. Finally, the input gesture is recognized by MCSVM-based machine learning from the feature data. To test our proposed hand gesture interface we implemented a 'Virtual Block' game. Our experiments showed about 99.2% recognition ratio of 16 kinds of command gestures and more intuitive and user friendly than conventional mouse interface.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.1348-1353
• /
• 2006

본 논문은 3 차원 게임 제어를 위한 인간의 동작인식에 대하여 기술하고 있다. 사용자의 편의성을 위하여 게임에 직관적으로 적용할 수 있는 인간의 동작들을 마커프리 모션 캡쳐 장비를 이용하여 취득하고, 이를 실시간으로 인식하는 동작 인식 시스템을 개발하였다. 또한, 개발된 동작인식기를 이용한 3차원 게임으로의 응용시스템의 접근 방식에 대하여 기술하고 있다. 개발된 동작 인식기는 LDA 방식에 기반을 둔 확률적 접근 방식으로 실시간으로 빠르고 정확하게 응용 시스템에 필요한 인간의 동작을 구별할 수 있도록 설계되었다. 개발된 시스템에서는 인식된 결과를 실시간으로 실제 어플리케이션에 전달하여 그 결과를 직접 사용자가 판단하여 다음 동작을 수행 할 수 있도록 되어 있다. 본 논문은, 이러한 실제 시스템의 개발을 통하여, 3 차원 인간 동작의 간단하고 유용한 활용 방법에 대한 해법을 제시하고 있다.

• Journal of Korea Multimedia Society
• /
• v.17 no.2
• /
• pp.248-256
• /
• 2014

This paper designs a serious game for rehabilitation of patients with body pains because they sit down for a long time in the same position, or less physical movement. Activity-based game induces to player improvements in physical exercise with fun elements of the game through entertainment to help the body function and substantially increases the player's commitment during challenging goal. This research is a game design that combines the treatment of color and movement of body to the rhythm of the music. We constructed with XNA Game Studio and KINECT interface with gesture recognition technology. We need to research of evaluation system and test for the actual effect of the treatment and advanced functions of game playes like adding various musics and variety of motion.