Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Emotion Recognition Method using Gestures and EEG Signals

제스처와 EEG 신호를 이용한 감정인식 방법

  • 김호덕 (중앙대학교 전자전기공학부) ;
  • 정태민 (중앙대학교 전자전기공학부) ;
  • 양현창 (중앙대학교 전자전기공학부) ;
  • 심귀보 (중앙대학교 전자전기공학부)
  • Published : 2007.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

Electroencephalographic(EEG) is used to record activities of human brain in the area of psychology for many years. As technology develope, neural basis of functional areas of emotion processing is revealed gradually. So we measure fundamental areas of human brain that controls emotion of human by using EEG. Hands gestures such as shaking and head gesture such as nodding are often used as human body languages for communication with each other, and their recognition is important that it is a useful communication medium between human and computers. Research methods about gesture recognition are used of computer vision. Many researchers study Emotion Recognition method which uses one of EEG signals and Gestures in the existing research. In this paper, we use together EEG signals and Gestures for Emotion Recognition of human. And we select the driver emotion as a specific target. The experimental result shows that using of both EEG signals and gestures gets high recognition rates better than using EEG signals or gestures. Both EEG signals and gestures use Interactive Feature Selection(IFS) for the feature selection whose method is based on a reinforcement learning.

Keywords

References

  1. Kazuhiko, Takahashi, 'Remarks on emotion recognition from Multi-modal Bio-potential signal,' IEEE International Conference on Industrial Technology(ICIT), 2004
  2. R. W. Picard. AFFECTIVE COMPUTING. The MIT PRESS. 1997
  3. 양현창, 김호덕, 박창현, 심귀보 '감정인식을 위한 Interactive Feature Selection(IFS) 알고리즘,' 퍼지 및 지능정보시스템 학회 논문지, vol 16, no 6, pp 647-652, 2006
  4. A. C. Merzagora, S. Bunce, M. Izzetoglu, and B. Onaral, 'Wavelet analysis for EEG feature extraction in deception detection,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
  5. E. D. Ubeyli, 'Fuzzy similarity index for discrimination of EEG signals,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
  6. S. Shigemura, T. Nishimura, M. tsubai, and H. yokoi, 'An investigation of EEG artifacts elimination using a neural network with Non-recursive 2nd order volterra filters,' Proc. of the 26th IEEE EMBS Annual International Conference, USA, September 2004
  7. H. Adeli, Samanwoy Ghosh-Dastidar, and Nahid Dadmehr, 'A wavelet-Chaos methodology for anlysis of EEGs and EEG subbands to detect seizure and epilepsy,' IEEE Transactions on Biomedical Engineering, vol. 54, no. 2, February 2007
  8. M. Ishikawa and N. Sasaki, 'Gesture recognition based on SOM using multiple sensors,' Proc. of the 9th International Conference on Neural Information Processing, vol. 3, pp 1300-1304, November 2002
  9. R. S. Sutton and A. G. Barto, Reinforcement Learning : An Introduction, A bradford book, London, 1998
  10. M. D. Korhonen, and D. A. Clausi, 'Modeling emotional content of nusic using system identification,' IEEE Transactions on Systems, Man, and Cybernetics- Part B: Cybernetics, vol. 36, no 3, June, 2002
  11. Z. Zeng, J. Tu, M. Liu, T. S. Huang, B. Pianfetti, Dan Roth, and Stephen Levinson, 'Audio-visual affect recognition,' IEEE Transactions on Multimedia, vol. 9, no 2, February 2007
  12. J. A. Russell, 'Evidence of convergent validity on the dimensions of affect,' Journal of Personality and Social Psychology. 36. 1152-1168 https://doi.org/10.1037/0022-3514.36.10.1152
  13. P. Ekman, 'Universals and cultural differences in facial expressions of emotion,' In J. Cole (Ed.), Nebraska Symposium on Motivation 1971. 19. 207-283. Lincoln, NE: University of Nebraska Press