• 제목/요약/키워드: timing of gestures

검색결과 5건 처리시간 0.018초

Electromyographic evidence for a gestural-overlap analysis of vowel devoicing in Korean

  • Jun, Sun-A;Beckman, M.;Niimi, Seiji;Tiede, Mark
    • 음성과학
    • /
    • 제1권
    • /
    • pp.153-200
    • /
    • 1997
  • In languages such as Japanese, it is very common to observe that short peripheral vowel are completely voiceless when surrounded by voiceless consonants. This phenomenon has been known as Montreal French, Shanghai Chinese, Greek, and Korean. Traditionally this phenomenon has been described as a phonological rule that either categorically deletes the vowel or changes the [+voice] feature of the vowel to [-voice]. This analysis was supported by Sawashima (1971) and Hirose (1971)'s observation that there are two distinct EMG patterns for voiced and devoiced vowel in Japanese. Close examination of the phonetic evidence based on acoustic data, however, shows that these phonological characterizations are not tenable (Jun & Beckman 1993, 1994). In this paper, we examined the vowel devoicing phenomenon in Korean using data from ENG fiberscopic and acoustic recorders of 100 sentences produced by one Korean speaker. The results show that there is variability in the 'degree of devoicing' in both acoustic and EMG signals, and in the patterns of glottal closing and opening across different devoiced tokens. There seems to be no categorical difference between devoiced and voiced tokens, for either EMG activity events or glottal patterns. All of these observations support the notion that vowel devoicing in Korean can not be described as the result of the application of a phonological rule. Rather, devoicing seems to be a highly variable 'phonetic' process, a more or less subtle variation in the specification of such phonetic metrics as degree and timing of glottal opening, or of associated subglottal pressure or intra-oral airflow associated with concurrent tone and stricture specifications. Some of token-pair comparisons are amenable to an explanation in terms of gestural overlap and undershoot. However, the effect of gestural timing on vocal fold state seems to be a highly nonlinear function of the interaction among specifications for the relative timing of glottal adduction and abduction gestures, of the amplitudes of the overlapped gestures, of aerodynamic conditions created by concurrent oral tonal gestures, and so on. In summary, to understand devoicing, it will be necessary to examine its effect on phonetic representation of events in many parts of the vocal tracts, and at many stages of the speech chain between the motor intent and the acoustic signal that reaches the hearer's ear.

  • PDF

An Acoustic Analysis of the Aspiration Merger in Korean

  • Mi, Jang
    • 말소리와 음성과학
    • /
    • 제3권1호
    • /
    • pp.67-75
    • /
    • 2011
  • In Korean, 'Aspiration Merger' is the result of the heteromorphemic sequence of lenis stop and /h/ becoming a single aspirated stop word-medially. However, the contrast between lenis stop-plus-/h/ and an underlying aspirated stop is maintained when they span Phonological Phrase boundaries. By varying the position in the prosodic domain such as APP (Across Phonological Phrase) and PPM (Phonological Phrase Medial) positions, the phonetic properties of the two categories are compared. In the results from noise duration and change of intensity, lenis stop-plus-/h/ show a large difference between the APP and PPM positions. The results from a noise duration comparison show that the two categories are completely neutralized into aspirated stop in the PPM position and the complete neutralization is sensitive to prosodic phrasing.

  • PDF

TV 가이드 영역에서의 음성기반 멀티모달 사용 유형 분석 (Speech-Oriented Multimodal Usage Pattern Analysis for TV Guide Application Scenarios)

  • 김지영;이경님;홍기형
    • 대한음성학회지:말소리
    • /
    • 제58호
    • /
    • pp.101-117
    • /
    • 2006
  • The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

  • PDF

체험형 게임콘텐츠를 위한 움직임 관성센서 기반의 제스처 인식 (Gesture Recognition based on Motion Inertial Sensors for Interactive Game Contents)

  • 정영기;차병래
    • 한국항행학회논문지
    • /
    • 제13권2호
    • /
    • pp.262-271
    • /
    • 2009
  • 본 연구에서는 게임 콘텐츠 제작을 위해 관성 센서를 이용하여 체험자의 동작을 인식하고 정의된 동작과 비교하여 게임을 즐길 수 있는 관성센서 기반의 제스처 인식방법을 제안하고자 한다. 또한 3축 가속도 센서를 이용한 소형 컨트롤러를 손에 착용하고 여러 가지 동작을 취함으로써 체험자에게 다양한 입력 방식을 제공하고자 한다. 체험자는 화면에 순서대로 출력되는 동작 리스트와 같은 움직임을 취하거나 동작의 정확도 및 타이밍에 따라 체험형 게임을 진행할 수 있다. 다수개의 소형 무선 컨트롤러를 손과 발 등 주요부위에 착용하고 논문에 제안된 방법을 활용하게 되면 사용자의 흥미와 몰입감을 더해줄 것으로 기대된다.

  • PDF

사용자 경험 디자인을 이용한 인간 동작 기반 스마트폰 UX 패턴 연구 (Study on Human Motion based Smartphone UX Pattern using User Experience Design)

  • 주정규;이준환;조한진
    • 디지털융복합연구
    • /
    • 제10권9호
    • /
    • pp.345-350
    • /
    • 2012
  • 본 연구에서는 사용자의 경험적인 요소를 바탕으로 직관적이고 쉬운 UX를 인맥관리 GUI에 적용시켜 사용자의 감성적 제스처를 이해하고 활용하는 것에 관점을 두었다. 개체와 개체의 관계를 노드 구조로 형상화 하여 보다 직관적으로 개체를 관리 할 수 있도록 하였다. 손쉬운 그룹핑과 관계의 확장성은 어려웠던 인맥 관리의 불필요한 정보의 과밀성을 최소화 하고 쉬운 구조로 표현하였으며 수정과 삭제의 관리 시간을 줄여주었다. 그러나 이러한 인터페이스의 환경은 많은 기술적 문화적 제약을 가지고 있으며, 이러한 제약적인 요소를 해소하기에는 다소 한계성을 가지고 있다. 본 연구에서는 본 연구에서 제시하는 새로운 인터렉션 경험이 감성의 표현 연구에 적극적으로 활용되어 보다 인간의 언어에 가까운 UX 표현연구에 활용되길 기대한다.