• Korean Journal of Cognitive Science
• /
• v.22 no.2
• /
• pp.123-143
• /
• 2011

At what point in the process of speech production are gestures involved? According to the Lexical Retrieval Hypothesis, gestures are involved in the lexicalization in the formulating stage. According to the Information Packaging Hypothesis, gestures are involved in the conceptual planning of massages in the conceptualizing stage. We investigated these hypotheses, using the game situation in a TV program that induced the players to involve in both lexicalization and conceptualization simultaneously. The transcription of the verbal utterances was augmented with all arm and hand gestures produced by the players. Coverbal gestures were classified into two types of gestures: lexical gestures and motor gestures. As a result, concrete words elicited lexical gestures significantly more frequently than abstract words, and abstract words elicited motor gestures significantly more frequently than concrete words. The difficulty of conceptualization in concrete words was significantly correlated with the amount of lexical gestures. However, the amount of words and the word frequency were not correlated with the amount of both gestures. This result supports the Information Packaging Hypothesis. Most of all, the importance of motor gestures was inferred from the result that abstract words elicited motor gestures more frequently rather than concrete words. Motor gestures, which have been considered as unrelated to verbal production, were excluded from analysis in many gestural studies. This study revealed motor gestures seemed to be connected to the abstract conceptualization.

• The Journal of Korea Robotics Society
• /
• v.14 no.3
• /
• pp.211-220
• /
• 2019

Surface electromyogram (sEMG), which is a bio-electrical signal originated from action potentials of nerves and muscle fibers activated by motor neurons, has been widely used for recognizing motion intention of robotic prosthesis for amputees because it enables a device to be operated intuitively by users without any artificial and additional work. In this paper, we propose a training-free unsupervised sEMG pattern recognition algorithm. It is useful for the gesture recognition for the amputees from whom we cannot achieve motion labels for the previous supervised pattern recognition algorithms. Using the proposed algorithm, we can classify the sEMG signals for gesture recognition and the calculated threshold probability value can be used as a sensitivity parameter for pattern registration. The proposed algorithm was verified by a case study of a patient with partial-hand amputation.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.6
• /
• pp.609-614
• /
• 2014

Cerebellar ataxia is a steadily progressive neurodegenerative disease associated with loss of motor control, leaving patients unable to walk, talk, or perform activities of daily living. Direct motor instruction in cerebella ataxia patients has limited effectiveness, presumably because an inappropriate closed-loop cerebellar response to the inevitable observed error confounds motor learning mechanisms. Recent studies have validated the age-old technique of employing motor imagery training (mental rehearsal of a movement) to boost motor performance in athletes, much as a champion downhill skier visualizes the course prior to embarking on a run. Could the use of EEG based BCI provide advanced biofeedback to improve motor imagery and provide a "backdoor" to improving motor performance in ataxia patients? In order to determine the feasibility of using EEG-based BCI control in this population, we compare the ability to modulate mu-band power (8-12 Hz) by performing a cued motor imagery task in an ataxia patient and healthy control.

• Phonetics and Speech Sciences
• /
• v.3 no.3
• /
• pp.27-33
• /
• 2011

This paper explores two articulatory characteristics of inter-consonantal coordination observed in lingual-lingual (/kt/, /ks/) and labial-lingual (/pt/) sequences. Using electromagnetic articulometry (EMMA), temporal aspects of the lip movement and lingual movement (of the tongue tip and the tongue dorsum) were examined. Three sequences (/ks/, /kt/, /pt/) were investigated in two respects: gestural overlap in C1C2 and formation duration of coronals in C2 (/t/ or /s/). Results are summarized as follows. First, in a sequence of two stop consonants gestural overlap did not vary with order contrast or a low-level motor constraint on lingual articulators. Gestural overlap between two stop consonants was similar in both /kt/ (lingual-lingual; back-to-front) and /pt/ (labial-lingual; front-to-back). Second, gestural overlap was not simply constrained by place of articulation. Two coronals (/s/ and /t/) shared the same articulator, the tongue tip, but they showed a distinctive gestural overlap pattern with respect to /k/ in C1 (/ks/ (less overlap) < /kt/ (more overlap)). Third, temporal duration of the tongue tip gesture varied as a function of manner of articulation of the target segment in C2 (/ks/ (shorter) < /kt/ (longer)) as well as a function of place of articulation of the segmental context in C1 (/pt/ (shorter) < /kt/ (longer)). There are several implications associated with the results from Korean non-assimilating contexts. First, Korean can be better explained in the way of its language-specific gestural pattern; gestural overlap in Korean is not simply attributed to order contrast (front-to-back vs. back-to-front) or a physiological motor constraint on lingual articulators (lingual-lingual vs. nonlingual-lingual). Taking all factors into consideration, inter-gestural coordination is influenced not only by C1 (place of articulation) but also C2 (manner of articulation). Second, the jaw articulator could have been a factor behind a distinctive gestural overlap pattern in different C1C2 sequences (/ks/ (less overlap) vs. /kt/ and /pt/ (more overlap)). A language-specific gestural pattern occurred with reference to a physiological motor constraint on the jaw articulator.

• Journal of Sensor Science and Technology
• /
• v.26 no.2
• /
• pp.128-134
• /
• 2017

Until now, neuropsychological tests can diagnose the brain dysfunction, however, cannot distinguish the objective data of experiment enough to distinguish the relationships between brain dysfunction and cerebropathia. In this paper, an automatic cognitive test equipment system with 6-axis motion sensors was proposed for the automation of neuropsychological tests. Fist-Edge-Palm(FEP) test and Go-no go test were used to evaluate motor programming of frontal lobe. The motion data from the specially designed motion glove are transmitted wirelessly to a computer to detect the gestures automatically. The healthy 20 and 11 persons are investigated for the FEP and Go-No go test, respectively. The recognition rates of gestures of FEP and Go-No go test are min. 91.38% and 89.09%. In conclusion, the automations of cognitive tests are successful to diagnose the brain diagnostics quantitatively.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.2
• /
• pp.67-78
• /
• 2019

Objective : The purpose of this study was to investigate the effect of hand tapping on the accuracy and the fluency of speech production in children with speech sound disorder(SSD) and their typically developing peers(TD). Methods : The study subjects were 15 SSD children and 15 TD children aged 4, 5, and 6 years of age. Subjects were asked to give a picture name without hand tapping in the first experimental condition, and with hand tapping in the second experiment condition. Results : The results showed that hand tapping significantly increased disfluency in TD, whereas in SSD. it did not affect the accuracy or fluency of speech production. In addition, TD demonstrated a significant positive correlation with the changes of accuracy and disfluency due to hand tapping, whereas SSD had no correlation. Conclusion : We discussed the possibility that hand tapping could serve as an obstacle distracting attention from SSD and TD, acting as a motor gesture to facilitate phonological processing when facing the difficulty in lexical retrieval for SSD.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.50-57
• /
• 2019

This work presents a design and control method for a flexible robot arm operated by a wire drive that follows human gestures. When moving the robot arm to a desired position, the necessary wire moving length is calculated and the motors are rotated accordingly to the length. A robotic arm is composed of a total of two module-formed mechanism similar to real human motion. Two wires are used as a closed loop in one module, and universal joints are attached to each disk to create up, down, left, and right movements. In order to control the motor, the anti-windup PID was applied to limit the sudden change usually caused by accumulated error in the integral control term. In addition, master/slave communication protocol and operation program for linking 6 motors to MYO sensor and IMU sensor output were developed at the same time. This makes it possible to receive the image information of the camera attached to the robot arm and simultaneously send the control command to the robot at high speed.

• Journal of Korea Entertainment Industry Association
• /
• v.15 no.3
• /
• pp.203-210
• /
• 2021

Yuri Vasilyev - actor, director and drama teacher. Russian meritorious artist, winner of the stage "Medal of Friendship" awarded by Russian President Vladimir Putin; academician of the Petrovsky Academy of Sciences and Arts in Russia, professor of the Russian National Academy of Performing Arts, and professor of the Bavarian Academy of Drama in Munich, Germany. The physiological sense stimulation method based on the improvement of voice, language and motor function of drama actors. On the basis of a systematic understanding of performing arts, Yuri Vasiliev created a unique training method of speech expression and skills. From the complicated art training, we find out the most critical skills for focused training, which we call basic skills training. Throughout the whole training process, Professor Yuri made a clear request for the actor's lines: "action! This is the basis of actors' creation. So action is the key! Action and voice are closely linked. Actor's voice is human voice, human life, human feeling, human experience and disaster. It is also the foundation of creation that actors acquire their own voice. What we are engaged in is pronunciation, breathing, tone and intonation, speed and rhythm, expressiveness, sincerity, stage voice and movement, gesture, all of which are used to train the voice of actors according to the standard of drama. In short, Professor Yuri's training course is not only the training of stage performance and skills, but also contains a rich view of drama and performance. I think, in addition to learning from the means and methods of training, it is more important for us to understand the starting point and training objectives of Professor Yuri's use of these exercises.