• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.40-44
• /
• 2009

In this paper, we evaluate the feasibility of a motion-based interaction for image browsing in the mobile device. We present the design of a motion-based interface and a navigation scheme. A designed interaction scheme was evaluated in a usability experiment alongside the conventional button-based interaction for image browsing. After enough training of user, the usability and the user task performance of the motion based interaction were significantly increased, approaching those of the button based interaction.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.2
• /
• pp.159-169
• /
• 2016

In order to realize the virtual prototyping (VP) of digital products, it is important to provide the people involved in product development with the appropriate visualization and interaction of the products, and the vivid simulation of user interface (UI) behaviors in an interactive 3D virtual environment. In this paper, we propose an approach to web-based 3D virtual experience using Unity and Leap Motion. We adopt Unity as an implementation platform which easily and rapidly implements the visualization of the products and the design and simulation of their UI behaviors, and allows remote users to get an easy access to the virtual environment. Additionally, we combine Leap Motion with Unity to embody natural and immersive interaction using the user's hand gesture. Based on the proposed approach, we have developed a testbed system for web-based 3D virtual experience and applied it for the design evaluation of various digital products. Button selection test was done to investigate the quality of the interaction using Leap Motion, and a preliminary user study was also performed to show the usefulness of the proposed approach.

• Journal of the Ergonomics Society of Korea
• /
• v.29 no.6
• /
• pp.925-932
• /
• 2010

Most of the research on three-dimensional interaction field have showed different accuracy in terms of sensing, mode and method. Furthermore, implementation of interaction has been a lack of consistency in application field. Therefore, this study is to suggest research trends of three-dimensional interaction using meta-analysis. Searching relative keyword in database provided with 153 domestic papers and 188 international papers covering three-dimensional interaction. Analytical coding tables determined 18 domestic papers and 28 international papers for analysis. Frequency analysis was carried out on method of action, element, number, accuracy and then verified accuracy by effect size of the meta-analysis. As the results, the effect size of sensor-based was higher than vision-based, but the effect size was extracted to small as 0.02. The effect size of vision-based using hand motion was higher than sensor-based using hand motion. Therefore, implementation of three-dimensional sensor-based interaction and vision-based using hand motions more efficient. This study was significant to comprehensive analysis of three-dimensional motion recognition for interaction and suggest to application directions of three-dimensional interaction.

• Journal of the HCI Society of Korea
• /
• v.3 no.1
• /
• pp.49-56
• /
• 2008

Most recent mobile devices can store a massive amount of images. However, the typical user interface of mobile devices, such as a small-size 2D display and discrete-input buttons, make the browsing and manipulation of images cumbersome and time-consuming. As an alternative, we adopt motion-based interaction along with a 3D layout of images, expecting such an intuitive and natural interaction may facilitate the tasks. We designed and implemented a motion-based interaction scheme for image browsing using an ultra mobile PC, and evaluated and compared its usability to that of the traditional button-based interaction. The effects of data layouts (tiled and fisheye cylindrical layouts) were also investigated to see whether they can enhance the effectiveness of the motion based interaction.

• Structural Engineering and Mechanics
• /
• v.33 no.4
• /
• pp.407-428
• /
• 2009

The effects of the uniform and spatially varying ground motions on the stochastic response of fluid-structure interaction system during an earthquake are investigated by using the displacement based fluid finite elements in this paper. For this purpose, variable-number-nodes two-dimensional fluid finite elements based on the Lagrangian approach is programmed in FORTRAN language and incorporated into a general-purpose computer program SVEM, which is used for stochastic dynamic analysis of solid systems under spatially varying earthquake ground motion. The spatially varying earthquake ground motion model includes wave-passage, incoherence and site-response effects. The effect of the wave-passage is considered by using various wave velocities. The incoherence effect is examined by considering the Harichandran-Vanmarcke and Luco-Wong coherency models. Homogeneous medium and firm soil types are selected for considering the site-response effect where the foundation supports are constructed. A concrete gravity dam is selected for numerical example. The S16E component recorded at Pacoima dam during the San Fernando Earthquake in 1971 is used as a ground motion. Three different analysis cases are considered for spatially varying ground motion. Displacements, stresses and hydrodynamic pressures occurring on the upstream face of the dam are calculated for each case and compare with those of uniform ground motion. It is concluded that spatially varying earthquake ground motions have important effects on the stochastic response of fluid-structure interaction systems.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.10
• /
• pp.927-932
• /
• 2010

Estimation methods of motion intention from bio-signal present challenges in man machine interaction(MMI) to offer user's command to machine without control of any devices. Measurements of meaningful bio-signals that contain the motion intention and motion estimation methods from bio-signal are important issues for accurate and safe interaction. This paper proposes a novel motion estimation sensor based on a geometrical muscle changes, and a motion estimation method using the sensor. For estimation of the motion, we measure the circumference change of the muscle which is proportional to muscle activation level using a flexible piezoelectric cable (pMAS, piezo muscle activation sensor), designed in band type. The pMAS measures variations of the cable band that originate from circumference changes of muscle bundles. Moreover, we estimate the elbow motion by applying the sensor to upper limb with least square method. The proposed sensor and prediction method are simple to use so that they can be used to motion prediction device and methods in rehabilitation and sports fields.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.12
• /
• pp.8563-8567
• /
• 2015

We propose a human-robot interaction(HRI) platform based on motion capture and mapping. Platform consists of capture, processing/mapping, and action parts. A motion capture sensor, computer, and avatar and/or physical robots are selected as capture, processing/mapping, and action part(s), respectively. Case studies-an interactive presentation and LEGO robot car are presented to show the design and implementation process of Kinect based HRI platform.

• Journal of Institute of Control, Robotics and Systems
• /
• v.14 no.2
• /
• pp.178-183
• /
• 2008

Human motion analysis is researched as a new method for human-robot interaction (HRI) because it concerns with the key techniques of HRI such as motion tracking and pose recognition. To analysis human motion, extracting features of human body from sequential images plays an important role. After finding the silhouette of human body from the sequential images obtained by CCD color camera, the skeleton model is frequently used in order to represent the human motion. In this paper, using the silhouette of human body, we propose the feature extraction method based on hybrid skeleton for detecting human motion. Finally, we show the effectiveness and feasibility of the proposed method through some experiments.

• ETRI Journal
• /
• v.35 no.2
• /
• pp.356-359
• /
• 2013

We present a method for tracking and interaction based on hybrid sensing for virtual environments. The proposed method is applied to motion tracking of whole areas, including the user's occlusion space, for a high-precision interaction. For real-time motion tracking surrounding a user, we estimate each joint position in the human body using a combination of a depth sensor and a wand-type physical user interface, which is necessary to convert gyroscope and acceleration values into positional data. Additionally, we construct virtual contents and evaluate the validity of results related to hybrid sensing-based whole-body tracking of human motion methods used to compensate for the occluded areas.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.418-421
• /
• 2009

This paper presents a human-machine interaction based on a realtime upper limb motion prediction method using surface electromyography (sEMG). The motions were predicted using an artificial neural network algorithm and sEMG signals which are acquired from five muscles, and then a manipulator was controlled to follow after the predicted motions. Upper limb motions were restricted to 2D vertical plane with the contact condition between a user and an end-effector of manipulator. In order to demonstrate the feasibility of the proposed method, experiments using developed method and using a goniometer were performed. The results showed that the proposed real-time motion prediction method can be implemented a human-machine interaction system.