• Information and Communications Magazine
• /
• v.29 no.7
• /
• pp.25-30
• /
• 2012

멀티터치 스크린 상에서의 접촉식 제스처 UI(User Interface)는 사용자가 안정적으로 손을 사용할 수 있는 정적인 상황에서 편리하게 사용할 수 있다. 하지만, 조깅을 한다거나 운전을 하는 등의 동적인 상황에서는 접촉식의 제스처 인터페이스는 심각한 사용성 문제를 야기 시킬 수 있다. 이에 본 연구에서는 정지 및 운동 상황 모두에서 사용할 수 있는 비접촉성 제스처 기반 인터랙션을 개발하고자 하였다. 비접촉성 제스처 UI 인식 방식은 컴퓨터 센서 제스처, 멀티 터치 제스처, 자이로 센서 세 가지로 제한하였다. 그리고 본 연구를 통해 정지 상황과 운동 상황에서 MP3 플레이어를 시용할 수 있는 제스처의 어휘 목록을 개발하였다. 마지막으로 본 연구의 제한점과 시사점을 논의하였다.

• Korean Journal of Cognitive Science
• /
• v.22 no.2
• /
• pp.123-143
• /
• 2011

At what point in the process of speech production are gestures involved? According to the Lexical Retrieval Hypothesis, gestures are involved in the lexicalization in the formulating stage. According to the Information Packaging Hypothesis, gestures are involved in the conceptual planning of massages in the conceptualizing stage. We investigated these hypotheses, using the game situation in a TV program that induced the players to involve in both lexicalization and conceptualization simultaneously. The transcription of the verbal utterances was augmented with all arm and hand gestures produced by the players. Coverbal gestures were classified into two types of gestures: lexical gestures and motor gestures. As a result, concrete words elicited lexical gestures significantly more frequently than abstract words, and abstract words elicited motor gestures significantly more frequently than concrete words. The difficulty of conceptualization in concrete words was significantly correlated with the amount of lexical gestures. However, the amount of words and the word frequency were not correlated with the amount of both gestures. This result supports the Information Packaging Hypothesis. Most of all, the importance of motor gestures was inferred from the result that abstract words elicited motor gestures more frequently rather than concrete words. Motor gestures, which have been considered as unrelated to verbal production, were excluded from analysis in many gestural studies. This study revealed motor gestures seemed to be connected to the abstract conceptualization.

• Journal of The Korean Association For Science Education
• /
• v.38 no.2
• /
• pp.273-291
• /
• 2018

Gestures accompanied by scientific discourses play an important role in constructing mental models and making model-based inferences. According to embodied cognition literature, gestures can be a source of recognition of the mental models of students and help them in changing naive beliefs about science. This study intends to compare the gestures of scientists with that of middle school students in explaining scientific phenomena and to explore the relationship between gestures and scientific discourse. In the study, 10 scientists and 10 middle school students participated in clinical interviews and the tests of knowledge and self-efficacy. Participants engaged in one-on-one clinical interviews with semi-structured questions about three tasks regarding the molecular movement and the state change of matter. Four researchers carried out open coding and applied a constant comparison method in order to analyze video-recorded gestures. This study found four themes (feature of gesture, use of gesture, content of gesture, function of gesture) about the differences of gestures between scientists and middle school students. Scientists used more diverse and elaborate gestures systematically and frequently in the interview. Although students used gestures in their scientific talk and reasoning, the gestures of students were not well grounded on scientific knowledge and had different functions from those of scientists. The findings revealed that gestures can represent underlying cognition and strengthen scientific thinking. We should encourage students to use gestures as a tool to understand scientific concepts and make inferences.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.35C no.6
• /
• pp.76-87
• /
• 1998

This paper deals with a system which recognizes dynmic hand gestures, Korean Sign Language(KSL), mixed with static hand gesture, Korean Manual Alphabet(KMA), continuously. Recognition of continuous hand gestures is very difficult for lack of explicit tokens indicating beginning and ending of signs and for complexity of each gesture. In this paper, state automata is used for segmenting sequential signs into individual ones, and basic elements of KSL and KMA, which consist of 14 hand directions, 23 hand postures and 14 hand orientations are used for recognition of complex gestures under consideration of expandability. Using a pair of CyberGlove and Polhemus sensor, this system recognizes 131 Korean signs and 31 KMA's in real-time with recognition rate 94.3% for KSL excluding no recognition case and 96.7% for KMA.

• The Transactions of the Korea Information Processing Society
• /
• v.4 no.12
• /
• pp.3033-3044
• /
• 1997

This paper presents a system which recognizes dynamic hand gesture for virtual reality (VR). A dynamic hand gesture is a method of communication for human and computer who uses gestures, especially both hands and fingers. Since the human hands and fingers are not the same in physical dimension, the produced by two persons with their hands may not have the same numerical values where obtained through electronic sensors. To recognize meaningful gesture from continuous gestures which have no token of beginning and end, this system segments current motion states using the state automata. In this paper, we apply a fuzzy min-max neural network and feature analysis method using fuzzy logic for on-line pattern recognition.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.20 no.9
• /
• pp.525-531
• /
• 2019

Efforts to utilize human gestures to effectively implement a more natural and interactive interface between humans and computers have been ongoing in recent years. In this paper, we propose a new algorithm that accepts consecutive three-dimensional (3D) depth images, defines a hand model, and robustly extracts the human hand region based on six palm joints and 15 finger joints. Then, the 3D depth images are adaptively binarized to exclude non-interest areas, such as the background, and accurately extracts only the hand of the person, which is the area of interest. Experimental results show that the presented algorithm detects only the human hand region 2.4% more accurately than the existing method. The hand region extraction algorithm proposed in this paper is expected to be useful in various practical applications related to computer vision and image processing, such as gesture recognition, virtual reality implementation, 3D motion games, and sign recognition.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.40 no.5
• /
• pp.863-870
• /
• 2015

A Compensation Algorithm for The Position of the User Hands based on the Moving Mean-Shift ($CAPUH_{MMS}$) in Human Robot Interface (HRI) System running the Kinect sensor is proposed in order to improve the performance of the gesture recognition is proposed in this paper. The average error improvement ratio of the trajectories ($AEIR_{TJ}$) in left-right movements of hands for the $CAPUH_{MMS}$ is compared with other compensation algorithms such as the Compensation Algorithm based on the Compensation Algorithm based on the Kalman Filter ($CA_{KF}$) and the Compensation Algorithm based on Least-Squares Method ($CA_{LSM}$) by the developed realtime performance simulator. As a result, the $AEIR_{TJ}$ in up-down movements of hands of the $CAPUH_{MMS}$ is measured as 19.35%, it is higher value compared with that of the $CA_{KF}$ and the $CA_{LSM}$ as 13.88% and 16.68%, respectively.

• The KIPS Transactions:PartB
• /
• v.15B no.3
• /
• pp.197-204
• /
• 2008

It is well known that the tracking a certain person is a vary needed technic in the humanoid robot. In robot technic, we should consider three aspects that is cloth color matching, face recognition and motion analysis. Because a robot technic use some sensors, it is many different with the robot technic to track a certain person through the CCTV images. A system speed should be fast in CCTV images, hence we must have small calculation numbers. We need the statistical variable for color matching and we adapt the eigen-face for face recognition to speed up the system. In this situation, motion analysis have to added for the propose of the efficient detecting system. But, in many motion analysis systems, the speed and the recognition rate is low because the system operates on the all image area. In this paper, we use the moving energy only on the face area which is searched when the face recognition is processed, since the moving energy has low calculation numbers. When the proposed algorithm has been compared with Girondel, V. et al's method for experiment, we obtained same recognition rate as Girondel, V., the speed of the proposed algorithm was the more faster. When the LDA has been used, the speed was same and the recognition rate was better than Girondel, V.'s method, consequently the proposed algorithm is more efficient for tracking a certain person.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.2
• /
• pp.67-78
• /
• 2019

Objective : The purpose of this study was to investigate the effect of hand tapping on the accuracy and the fluency of speech production in children with speech sound disorder(SSD) and their typically developing peers(TD). Methods : The study subjects were 15 SSD children and 15 TD children aged 4, 5, and 6 years of age. Subjects were asked to give a picture name without hand tapping in the first experimental condition, and with hand tapping in the second experiment condition. Results : The results showed that hand tapping significantly increased disfluency in TD, whereas in SSD. it did not affect the accuracy or fluency of speech production. In addition, TD demonstrated a significant positive correlation with the changes of accuracy and disfluency due to hand tapping, whereas SSD had no correlation. Conclusion : We discussed the possibility that hand tapping could serve as an obstacle distracting attention from SSD and TD, acting as a motor gesture to facilitate phonological processing when facing the difficulty in lexical retrieval for SSD.

• Cartoon and Animation Studies
• /
• s.36
• /
• pp.147-165
• /
• 2014

Around the turn of 21st century, there has been a major technological shift in the animation industry. With development of reality-based computer graphics, major American animation studios replaced hand-drawn method with the new 3D computer graphics. Traditional animation was known for its simplified shapes such as circles and triangle that makes characters' movements distinctive from non-animated feature films. Computer-generated animation has largely replaced it, but is under continuous criticism that automated movements and reality-like graphics devaluate the aesthetics of animation. Although hand-drawn animation is still produced, 3D computer graphics have taken commercial lead and there has been many changes to acting of animated characters, which calls for detailed investigation. Firstly, the changes in acting of 3D characters can be traced from looking at human-like rigging method that mimics humanistic moving mechanism. Also, if hair and clothing was part of hand-drawn characters' acting, it has now been hidden inside mathematical simulation of 3D graphics, leaving only the body to be used in acting. Secondly, looking at "Stretch and Squash" method, which represents the distinctive movements of animation, through the lens of media, a paradox arises. Hand-drawn animation are produced frame-by-frame, and a subtle change would make animated frames shiver. This slight shivering acts as an aesthetic distinction of animated feature films, but can also require exaggerated movements to hide the shivering. On the contrary, acting of 3D animation make use of calculated movements that may seem exaggerated compared to human acting, but seem much more moderate and static compared to hand-drawn acting. Moreover, 3D computer graphics add the third dimension that allows more intuitive movements - maybe animators no longer need fine drawing skills; what they now need is directing skills to animate characters in 3D space intuitively. On the assumption that technological advancement and change of artistic expressionism are inseparable, this paper compares acting of 3D animation studio Pixar and classical drawing studio Disney to investigate character acting style and movements.