• Title/Summary/Keyword: timing of gestures

Search Result 5, Processing Time 0.021 seconds

Electromyographic evidence for a gestural-overlap analysis of vowel devoicing in Korean

  • Jun, Sun-A;Beckman, M.;Niimi, Seiji;Tiede, Mark
    • Speech Sciences
    • /
    • v.1
    • /
    • pp.153-200
    • /
    • 1997
  • In languages such as Japanese, it is very common to observe that short peripheral vowel are completely voiceless when surrounded by voiceless consonants. This phenomenon has been known as Montreal French, Shanghai Chinese, Greek, and Korean. Traditionally this phenomenon has been described as a phonological rule that either categorically deletes the vowel or changes the [+voice] feature of the vowel to [-voice]. This analysis was supported by Sawashima (1971) and Hirose (1971)'s observation that there are two distinct EMG patterns for voiced and devoiced vowel in Japanese. Close examination of the phonetic evidence based on acoustic data, however, shows that these phonological characterizations are not tenable (Jun & Beckman 1993, 1994). In this paper, we examined the vowel devoicing phenomenon in Korean using data from ENG fiberscopic and acoustic recorders of 100 sentences produced by one Korean speaker. The results show that there is variability in the 'degree of devoicing' in both acoustic and EMG signals, and in the patterns of glottal closing and opening across different devoiced tokens. There seems to be no categorical difference between devoiced and voiced tokens, for either EMG activity events or glottal patterns. All of these observations support the notion that vowel devoicing in Korean can not be described as the result of the application of a phonological rule. Rather, devoicing seems to be a highly variable 'phonetic' process, a more or less subtle variation in the specification of such phonetic metrics as degree and timing of glottal opening, or of associated subglottal pressure or intra-oral airflow associated with concurrent tone and stricture specifications. Some of token-pair comparisons are amenable to an explanation in terms of gestural overlap and undershoot. However, the effect of gestural timing on vocal fold state seems to be a highly nonlinear function of the interaction among specifications for the relative timing of glottal adduction and abduction gestures, of the amplitudes of the overlapped gestures, of aerodynamic conditions created by concurrent oral tonal gestures, and so on. In summary, to understand devoicing, it will be necessary to examine its effect on phonetic representation of events in many parts of the vocal tracts, and at many stages of the speech chain between the motor intent and the acoustic signal that reaches the hearer's ear.

  • PDF

An Acoustic Analysis of the Aspiration Merger in Korean

  • Mi, Jang
    • Phonetics and Speech Sciences
    • /
    • v.3 no.1
    • /
    • pp.67-75
    • /
    • 2011
  • In Korean, 'Aspiration Merger' is the result of the heteromorphemic sequence of lenis stop and /h/ becoming a single aspirated stop word-medially. However, the contrast between lenis stop-plus-/h/ and an underlying aspirated stop is maintained when they span Phonological Phrase boundaries. By varying the position in the prosodic domain such as APP (Across Phonological Phrase) and PPM (Phonological Phrase Medial) positions, the phonetic properties of the two categories are compared. In the results from noise duration and change of intensity, lenis stop-plus-/h/ show a large difference between the APP and PPM positions. The results from a noise duration comparison show that the two categories are completely neutralized into aspirated stop in the PPM position and the complete neutralization is sensitive to prosodic phrasing.

  • PDF

Speech-Oriented Multimodal Usage Pattern Analysis for TV Guide Application Scenarios (TV 가이드 영역에서의 음성기반 멀티모달 사용 유형 분석)

  • Kim Ji-Young;Lee Kyong-Nim;Hong Ki-Hyung
    • MALSORI
    • /
    • no.58
    • /
    • pp.101-117
    • /
    • 2006
  • The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

  • PDF

Gesture Recognition based on Motion Inertial Sensors for Interactive Game Contents (체험형 게임콘텐츠를 위한 움직임 관성센서 기반의 제스처 인식)

  • Jung, Young-Kee;Cha, Byung-Rae
    • Journal of Advanced Navigation Technology
    • /
    • v.13 no.2
    • /
    • pp.262-271
    • /
    • 2009
  • The purpose of this study was to propose the method to recognize gestures based on inertia sensor which recognizes the movements of the user using inertia sensor and lets the user enjoy the game by comparing the recognized movements with the pre-defined movements for the game contents production. Additionally, it was tried to provide users with various data entry methods by letting them wear small controllers using three-axis accelerator sensor. Users can proceed the game by moving according to the action list printed on the screen. They can proceed the experiential games according to the accuracy and timing of their movements. If they use multiple small wireless controllers together wearing them on the major parts of hands and feet and utilize the proposed methods, they will be more interested in the game and be absorbed in it.

  • PDF

Study on Human Motion based Smartphone UX Pattern using User Experience Design (사용자 경험 디자인을 이용한 인간 동작 기반 스마트폰 UX 패턴 연구)

  • Joo, Jeong-Gyu;Lee, Jun-Hwan;Cho, Han-Jin
    • Journal of Digital Convergence
    • /
    • v.10 no.9
    • /
    • pp.345-350
    • /
    • 2012
  • People established a network much more using smart equipments by means of the development of the mobile industry. They can get useful information easily, make new personal connections and communities, and form various personal connections using the communities. The importance of contact, timing, and utility of time plays an important role in human relations. Many programs related to personal relations are already saturated. In other words, they are very significant and difficult to use. Many programs that didn't be concerned ahead of time about how to deal with a lot of the amount of information effectively and take it out in order to use it could bring about negative results. Human being already makes use of physical-empirical language in all of the conscious and unconscious areas. This study begins at the supposition that how to make it easy to apply humane gestures and languages to applications with portable equipment close to human beings.