The Journal of the Acoustical Society of Korea

The Acoustical Society of Korea (한국음향학회)
권호 표지

Recognition of Emotion and Emotional Speech Based on Prosodic Processing

  • Kim, Sung-Ill (Division of Electronic and Electrical Engineering, College of Engineering, Kyungnam University)
  • Published : 2004.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents two kinds of new approaches, one of which is concerned with recognition of emotional speech such as anger, happiness, normal, sadness, or surprise. The other is concerned with emotion recognition in speech. For the proposed speech recognition system handling human speech with emotional states, total nine kinds of prosodic features were first extracted and then given to prosodic identifier. In evaluation, the recognition results on emotional speech showed that the rates using proposed method increased more greatly than the existing speech recognizer. For recognition of emotion, on the other hands, four kinds of prosodic parameters such as pitch, energy, and their derivatives were proposed, that were then trained by discrete duration continuous hidden Markov models(DDCHMM) for recognition. In this approach, the emotional models were adapted by specific speaker's speech, using maximum a posteriori(MAP) estimation. In evaluation, the recognition results on emotional states showed that the rates on the vocal emotions gradually increased with an increase of adaptation sample number.

Keywords

References

  1. F. Dellaert, T. Polzin, A. Waibel, 'Recognizing Emotion in Speech', Proc. of the ICSLP'96, October, 1996
  2. T. Moriyama and S. Ozawa, 'Emotion Recognition and Synthesis System on Speech', Proc. of International Conference on Multimedia Computing and Systems(ICMCS'99), Florence, Italy, 1999
  3. D. Roy, A. Pentland. Automatic, 'Spoken Affect Classification and Analysis', Proc. of the 2nd International Conference on Automatic Face and Gesture Recognition, pp 363-367, 1996
  4. Y. Yu, E. Chang and C. Li, 'Computer Recognition of Emotion in Speech', The 2002 Intel International Science and Engineering Fair, 2002
  5. L. Rabiner and B-H. Juang, 'Fundamentals of Speech Recognition', Prentice Hall Signal Processing Series, 1993
  6. Y. Tsurumi and S. Nakagawa, 'An Unsupervised Speaker Adaptation Method for Continuous Parameter HMM by Maximum a Posteriori Probability Estimation', Proc. of ICSLP'94, pp.431-434, 1994
  7. Waibel, A, 'Prosody and Speech Recognition', Doctoral Thesis, Carnegie Mellon Univ. 1986
  8. C Tuerk, 'A Text to Speech System based on NETtaIk', Master's Thesis, Cambridge University Englneering Dept, 1990
  9. David Talkin. 'A robust algorithm for pitch tracking (RAPT),' in Speech Coding and Synthesis, Elsevier Science, Amsterdam, pp.495-518, 1995
  10. Alice E. Turk, James R. Sawusch, 'The processing of duration and intensity cues to prominence', Journal of the Acoustical Society of America, 99(6), 3782-3790, June 1996 https://doi.org/10.1121/1.414995
  11. A. Fernald, 'Approval and disapproval: Infant responsiveness to vocal affect in familiar and unfamiliar languages', Developmental Psychology, 64, pp 657-674, 1993
  12. Rosalind W. Picard, 'Affective Computing', MIT Press, Cambridge, MA, 1997
  13. Deb Roy, Alex Pentland, 'Automatic spoken affect classification and analysis', IEEE Face and Gesture Conference, Killington, VT, pp.363-367, 1996
  14. E. Vyzas, 'Recognition of Emotional and Cognitive States Using Physiological Data', Mechanical Engineer's Degree Thesis, MIT, June 1999
  15. J. L. Armony, D. Servan-Schreiber, J. D. Cohen, and J. E. LeDoux, 'Computational modeling of emotion: Explorations through the anatomy and physiology of fear conditioning', Trends in Cognitive Sciences, 1(1), 28-34, April 1997
  16. L. R. Rabiner, R. W. Schafer, Digital Processing of Speech Signal, (Prentice-Hall), 1978
  17. C. Becchetti and L. P. Ricotti, Speech Recogniton: Theory and C++ Implementation, (John Wiley & Sons, 2000)
  18. K.F.Lee, Automatic Speech Recognition; The Development of SPHINX System, Kluwer Academic Publisher, Norwell, Mass., 1989
  19. 'Julius' Japanese large vocabulary continuous speech recognition system Available: http://winnie.kuis.kyoto-u.ac.jp/pub/julius/index.html