Journal of Music and Human Behavior (인간행동과 음악연구)

Korean Music Therapy Education Association (한국음악치료교육학회)
권호 표지
DOI QR코드

DOI QR Code

Tonal Characteristics Based on Intonation Pattern of the Korean Emotion Words

감정단어 발화 시 억양 패턴을 반영한 멜로디 특성

  • Yi, Soo Yon (Nam-dong Community Center) ;
  • Oh, Jeahyuk (Department of Korean Language and Literature, Konkuk University) ;
  • Chong, Hyun Ju (Department of Music Therapy, Graduate School, Ewha Womans University)
  • 이수연 (인천남동장애인종합복지관) ;
  • 오재혁 (건국대학교 국어국문학과) ;
  • 정현주 (이화여자대학교 대학원 음악치료학과)
  • Received : 2016.10.26
  • Accepted : 2016.11.23
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study investigated the tonal characteristics in Korean emotion words by analyzing the pitch patterns transformed from word utterance. Participants were 30 women, ages 19-23. Each participant was instructed to talk about their emotional experiences using 4-syllable target words. A total of 180 utterances were analyzed in terms of the frequency of each syllable using the Praat. The data were transformed into meantones based on the semi-tone scale. When emotion words were used in the middle of a sentence, the pitch pattern was transformed to A3-A3-G3-G3 for '즐거워서(joyful)', C4-D4-B3-A3 for '행복해서(happy)', G3-A3-G3-G3 for '억울해서(resentful)', A3-A3-G3-A3 for '불안해서(anxious)', and C4-C4-A3-G3 for '침울해서(frustrated)'. When the emotion words were used at the end of a sentence, the pitch pattern was transformed to G4-G4-F4-F4 for '즐거워요(joyful)', D4-D4-A3-G3 for '행복해요(happy)', G3-G3-G3-A3 and F3-G3-E3-D3 for '억울해요(resentful)', A3-G3-F3-F3 for '불안해요(anxious)', and A3-A3-F3-F3 for '침울해요(frustrated)'. These results indicate the differences in pitch patterns depending on the conveyed emotions and the position of words in a sentence. This study presents the baseline data on the tonal characteristics of emotion words, thereby suggesting how pitch patterns could be utilized when creating a melody during songwriting for emotional expression.

본 연구는 감정단어의 억양 패턴을 음향학적으로 분석하여 멜로디의 음높이 패턴으로 전환한 뒤 그 특성을 알아보았다. 이를 위해 만 19-23세 여성 30명을 대상으로 기쁨, 화남, 슬픔을 표현하는 4음절 감정단어의 음성자료를 수집하였다. 총 180개의 어휘를 수집하고 Praat 프로그램을 이용하여 음절 당 평균 주파수(f0)를 측정한 후 평균 음정과 음높이 패턴의 멜로디 요소로 전환하였다. 연구 결과, 첫째, 감정단어의 음높이 패턴은 '즐거워서' A3-A3-G3-G3, '즐거워요' G4-G4-F4-F4, '행복해서' C4-D4-B3-A3, '행복해요' D4-D4-A3-G3, '억울해서' G3-A3-G3-G3, '억울해요' G3-G3-G3-A3, F3-G3-E3-D3, '불안해서' A3-A3-G3-A3, '불안해요' A3-G3-F3-F3, '침울해서' C4-C4-A3-G3, '침울해요' A3-A3-F3-F3으로 나타났다. 둘째, 음 진행에서는 기쁨이 넓은 간격의 도약 진행, 화남이 좁은 간격의 도약 진행, 슬픔이 넓은 간격의 순차 진행 특성을 보였다. 본 연구에서는 감정의 속성과 본질, 한국어의 음성 특성을 고려하여 감정단어의 억양 패턴을 분석하고, 이를 멜로디 요소에 반영한 특성을 제시하였다. 또한, 체계적이고 객관화된 방법으로 말과 멜로디의 전환 가능성 및 적합성을 확인한 것에 의의가 있다. 본 연구의 결과는 감정을 효과적으로 표현할 수 있는 멜로디 창작 방안을 마련하기 위한 근거 자료로 활용될 수 있다.

Keywords

References

  1. Baker, F. A., & Wigram, T. (2005). Songwriting: Methods, techniques and clinical applications for music therapy clinicians, educators and students. London: Jessica Kingsley Publishers.
  2. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614-636. https://doi.org/10.1037/0022-3514.70.3.614
  3. Bӓnziger, T., & Scherer, K. R. (2005). The role of intonation in emotional expressions. Speech Communication, 46(3-4), 252-267. https://doi.org/10.1016/j.specom.2005.02.016
  4. Chong, H. J. (2011). Influence of music on human behavior(인간행동과 음악). Paju: Hakjisa
  5. Costa, M., Fine, P., & Ricci Bitti, P. E. (2004). Interval distributions, mode, and tonal strength of melodies as predictors of perceived emotion. Music Perception, 22(1), 1-14. https://doi.org/10.1525/mp.2004.22.1.1
  6. Coutinho, E., & Dibben, N. (2013). Psychoacoustic cues to emotion in speech prosody and music. Cognition and Emotion, 27(4), 658-684. https://doi.org/10.1080/02699931.2012.732559
  7. Eerola, T., & Vuoskoski, J. K. (2011). A comparison of the discrete and dimensional models of emotion in music. Psychology of Music, 39(1), 18-49. https://doi.org/10.1177/0305735610362821
  8. Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6, 169-200. https://doi.org/10.1080/02699939208411068
  9. Friend, M., & Bryant, J. (2000). A developmental lexical bias in the interpretation of discrepant messages. Merrill-Palmer Quarterly, 46(2), 342-369.
  10. Gerardi, G. M., & Gerken, L. (1995). The development of affective responses to modality and melodic contour. Music Perception, 12(3), 279-290. https://doi.org/10.2307/40286184
  11. Ilie, G., & Thompson, W. F. (2006). A comparison of acoustic cues in music and speech for three dimensions of affect. Music Perception, 23(4), 319-330. https://doi.org/10.1525/mp.2006.23.4.319
  12. Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count for more than statistics. Journal of Memory and Language, 44, 548-567. https://doi.org/10.1006/jmla.2000.2755
  13. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129(5), 770-814. https://doi.org/10.1037/0033-2909.129.5.770
  14. Juslin, P. N., & Sloboda, J. A. (2010). Handbook of music and emotion: Theory, research, applications. Oxford, UK: Oxford University Press.
  15. Juslin, P. N., & Vastfjall, D. (2008). Emotional responses to music: The need to consider underlying mechanisms. Behavioral and Brain Sciences, 31(5), 559-575.
  16. Kang, B. M. & Kim, H. G. (2004). Frequency analysis of Korean morpheme and word usage (한국어 형태소 및 어휘 사용 빈도의 분석). Seoul: Research Institute of Korean Studies, Korea University.
  17. Kim, J. Y. (2014). A study on direction of emotional vocabulary education for building emotional literacy(정서적 문식성 향상을 위한 정서어휘 교육의 방향). Journal of CheongRam Korean Language Education, 49, 321-345.
  18. Lee, H. Y., & Sohn, N. H. (2007). Perception of phrasal tones in Korean(한국어 말토막 억양 패턴의 인지). Hangeul, 277, 5-45.
  19. Lee, S. H. (2002). K-ToBI Labelling system: A study of description system of Korean prosodic structure(한국어 운율구조 기술 체계에 대한 연구: K-ToBI 기술 체계를 중심으로). The Linguistics Association of Korea Journal, 10(2), 1-18.
  20. Lindsay, P. H., & Norman, D. A. (1977). Human information processing: An introduction to psychology. London: Academic Press.
  21. Moon, K. H. (2012). A study on the speaking education of Korean emotional expression vocabulary(한국어 감정표현 어휘에 대한 말하기 교육). Poetics & Linguistics, 22, 175-200.
  22. Morton, J. B., & Trehub, S. E. (2001). Children's understanding of emotion in speech. Child Development, 72(3), 834-843. https://doi.org/10.1111/1467-8624.00318
  23. Owens, R. E. (2005). Language development: An introduction (6th ed.). Boston: Pearson /Allyn and Bacon.
  24. Park, I. J., & Min, K. H. (2005). Making a list of Korean emotion terms and exploring dimensions underlying them(한국어 감정단어의 목록 작성과 차원 탐색). Korean Journal of Social and Personality Psychology, 19(1), 109-129.
  25. Park, M. Y., & Park, M. K. (2007). An analysis of emotional speech using distribution chart of f(0)(기본주파수 분포도를 이용한 감정 발화 분석). Korean Linguistics, 27, 233-254.
  26. Patel, A. D., & Peretz, I. (1997). Is music autonomous from language? A neuropsychological appraisal. In I. Deliege, & J. A. Sloboda (Eds.), Perception and cognition of music. Philadelphia: Psychology Press.
  27. Plutchik, R. (1994). The psychology and biology of emotion. New York: Harper-Collins.
  28. Rhee, J. W., Song, H. J., Na, E. K., & Kim, H. S. (2008). Classification of emotion terms in Korean(정서 단어 분류를 통한 정서의 구성차원 및 위계적 범주에 관한 연구). Korean Journal of Journalism & Communication Studies, 52(1), 85-116.
  29. Rodero, E. (2011). Intonation and emotion: Influence of pitch levels and contour type on creating emotions. Journal of Voice, 25(1), 25-34. https://doi.org/10.1016/j.jvoice.2010.02.002
  30. Ross, D., Choi, J., & Purves, D. (2007). Musical intervals in speech. Proceedings of the National Academy of Sciences, 104(23), 9852-9857. https://doi.org/10.1073/pnas.0703140104
  31. Russell, J. A. (1978). Evidence of convergent validity on the dimensions of affect. Journal of Personality and Social Psychology, 36(10), 1152-1168. https://doi.org/10.1037/0022-3514.36.10.1152
  32. Russell, J. A., & Barrett, L. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76(5), 805-819. https://doi.org/10.1037/0022-3514.76.5.805
  33. Seong, C. J. (2013). Script_toneLabler_cj.praat. [computer program]. http://cjseong.blog.com
  34. Shin, J. Y. (2011). Korean phonetics and phonology(한국어의 말소리). Seoul: Jisik & Gyoyang.
  35. Shriberg, L. D., Paul, R., McSweeny, J. L., Klin, A. M., Cohen, D. J., & Volkmar, F. R. (2001). Speech and prosody characteristics of adolescents and adults with high-functioning autism and Asperger syndrome. Journal of Speech, Language, and Hearing Research, 44, 1097-1115. https://doi.org/10.1044/1092-4388(2001/087)
  36. Sohn, S. J., Park, M. S., Park, J. E., & Sohn, J. H. (2012). Korean emotional vocabulary: Extraction and categorization of feeling words(감정표현단어의 추출과 범주화). Korean Journal of the Science of Emotion & Sensibility, 15(1), 105-120.
  37. Thompson, W. F., & Robitaille, B. (1992). Can composers express emotions through music? Empirical Studies of the Arts, 10, 79-89. https://doi.org/10.2190/NBNY-AKDK-GW58-MTEL
  38. Van Rheenen, T. E., & Russell, S. L. (2013). Auditory-prosodic processing in bipolar disorder: From sensory perception to emotion. Journal of Affective Disorders, 151(3), 1102-1107. https://doi.org/10.1016/j.jad.2013.08.039
  39. Yi. H. B. (2008). Standardized Korean pronouncing dictionary: Sounds, accent, rhythm(한국어 표준발음사전: 발음, 강세, 리듬) (2nd ed.). Seoul: Seoul National University.
  40. Yi, S. P. (2014). An acoustical analysis of emotional speech using close-copy stylization of intonation curve(억양의 근접복사 유형화를 이용한 감정음성의 음향분석). Phonetics and Speech Science, 6(3), 131-138. https://doi.org/10.13064/KSSS.2014.6.3.131
  41. Yi, S. Y., & Chong, H. J. (2015). An analysis of tonal characteristics in pre-school children's word utterance(학령전기 아동 발화 단어의 선율 특성 분석). Phonetics and Speech Science, 7(2), 85-94. https://doi.org/10.13064/KSSS.2015.7.2.085
  42. Zentner, M., Grandjean, D., & Scherer, K. R. (2008). Emotions evoked by the sound of music: Characterization, classification, and measurement. Emotion, 8(4), 494-521. https://doi.org/10.1037/1528-3542.8.4.494

Cited by

  1. 정서 어휘에 반영된 선율 특성에 적합한 화음 구성과 전개 vol.8, pp.9, 2016, https://doi.org/10.15207/jkcs.2017.8.9.265