• Journal of the Korea Society of Computer and Information
• /
• v.26 no.11
• /
• pp.51-57
• /
• 2021

In this paper, we propose a new framework that calculates the user's hand motions using a Leap Motion device, and uses this to practice and analyze arm muscles as well as juggling motions. The proposed method can map the movement of the ball in a virtual environment according to the user's hand motions in real time, and analyze the amount of exercise by visualizing the relaxation and contraction of the muscles. The proposed framework consists of three main parts : 1) It tracks the user's hand position with the Leap Motion device. 2) As with juggling, the action pattern of the user throwing the ball is defined as an event. 3) We propose a parabola-based particle method to map the movement of a juggling shape to a ball based on the user's hand position. As a result, using the our framework, it is possible to play a juggling game in real-time.

• Journal of Korea Game Society
• /
• v.15 no.1
• /
• pp.27-34
• /
• 2015

This paper proposes a user interface for enhancing immersiveness and usability by combining hologram and haptic device with common Leap Motion. While Leap Motion delivers physical motion of user hand to control virtual environment, it is limited to handle virtual hands on screen and interact with virtual environment in one way. In our system, hologram is coupled with Leap Motion to improve user immersiveness by arranging real and virtual hands in the same place. Moreover, we provide a interaction prototype of sense by designing a haptic device to convey touch sense in virtual environment to user's hand.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.333-334
• /
• 2018

This is a study on controlling a drone (DJI Mavic Air) with simple hand gesture using Leap Motion controller. Four component involve are MacBook, Leap Motion controller, Android device, and DJI Mavic Air. All of this component are connected through USB, Bluetooth, and Wi-Fi technology. The studies main purpose are to show that by controlling a drone through Leap Motion, drone amateur user can easily learn how to control a drone, and because of longer drone control range can be archived things such as search and rescue mission will be possible.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.19 no.9
• /
• pp.2006-2013
• /
• 2015

Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

• Journal of Digital Contents Society
• /
• v.17 no.4
• /
• pp.287-293
• /
• 2016

Some studies require sufficient amount of time, spaces, and financial condition for practical exercises and training. In particular for the Medical education, time and space limitation is very high and difficulties occurs, since the practices are done with cadavers (deceased human body). Many alternate 3D Virtual surgery training system exist currently, however the burdensome of obtaining those costly equipments is problematic. Providing the surgical environment as similar to real as possible using 3D Virtual Reality can be a solution to current problems. The effectiveness of training could be maximized with minimized costs without the general interfaces such as keyboard and mouse, but with Oculus Rift and Leap Motion. This paper will develop and practice the 3D Virtual Operation System with two devices to investigate the possibility and expand to other Simulation fields.

• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.53-62
• /
• 2017

VR content manipulation equipment is not easy for individuals to access because it requires high prices. Especially, in the case of a system for tracking the motion of the user among the VR contents, a separate optical sensor device using an infrared camera is generally used. The disadvantage of the optical sensor equipment is that the measurable range is dependent on the measurement direction when tracking the rotation motion when using only a single device. In order to solve the above problems, this paper shows that the inertial sensor of the smartphone, which is generally owned by the public, can track the rotational motion of the user regardless of the measurement direction . The system using the LeapMotion is used as the reference system, and the system using the smart phone is defined as the evaluation system, and the usability of the evaluation system is verified by comparing the user satisfaction of the two systems.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.3
• /
• pp.93-100
• /
• 2018

This paper proposes a small-scale rehabilitation system that allows stroke patients to perform daily rehabilitation training in a virtual home. Stroke patients have limited activities of daily living due to paralysis, and there are many rehabilitation exercises for them to reproduce activities that take place in the house, such as turning lights on and off, door opening and closing, gas valve locking. In this paper, we have implemented a virtual home with the above mentioned daily rehabilitation training elements, by using virtual reality technology. We use Leap Motion, a hand motion recognition device, for rehabilitation of hands and fingers. It is expected that stroke patients can rehabilitate small muscles without having to visit the clinic with uncomfortable body, and will be able to get interesting rehabilitation training by avoiding monotony of existing rehabilitation tools.

• Journal of the Korea Society of Computer and Information
• /
• v.19 no.8
• /
• pp.129-137
• /
• 2014

The patients who have illness of hand and upper limb should be received rehabilitation treatment to recover such illness. The rehabilitation treatments is a treatments designed to facilitate the process of recovery from injury, illness, or disease to as normal a condition as possible. This should be done continuously and repeatedly. In this paper, we describe hand-rehabilitation system which provides a treatment method improving and recovering the function of injured hands. Expecially, this system is using a leap motion device which can easily and properly identify and trace a hand motion and provide six treatment patterns for hand rehabilitation. By using this system, the patients can do rehabilitation treatment easily and continuously in their daily life and in result, the achievement of treatment will be improved.

• Journal of the Korea Computer Graphics Society
• /
• v.19 no.2
• /
• pp.1-8
• /
• 2013

Captured human motion data has been widely utilized for understanding the mechanism of human motion and synthesizing the animation of virtual characters. Searching for desired motions from given motion data is an important prerequisite of analyzing and editing those selected motions. This paper presents a new method of content-based motion retrieval without the need of additional metadata such as keywords. While existing search methods have focused on skeletal configurations of body pose or planar trajectories of locomotion, our method receives a three-dimensional trajectory as its input query and retrieves a set of motion intervals in which the trajectories of body parts such as hands, foods, and pelvis are similar to the input trajectory. In order to allow the user to intuitively sketch spatial trajectories, we used the Leap Motion controller that can precisely trace finger movements as the input device for our experiments. We have evaluated the effectiveness of our approach by conducting a user study in which the users search for dozens of pre-selected motions from baseketball motion data including a variety of moves such as dribbling and shooting.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.87-94
• /
• 2017

This paper presents a prototype for virtual reality operating system (VR OS) concept with head mount display (HMD) and hand gesture recognition technology based on game engine (Unity3D). We have designed and implemented simple multitasking thread mechanism constructed on the realtime environment provided by Unity3D game engine. Our virtual reality operating system receives user input from the hand gesture recognition device (Leap Motion) to simulate mouse and keyboard and provides output via head mount display (Oculus Rift DK2). As a result, our system provides users with more broad and immersive work environment by implementing 360 degree work space.