KNOM Review

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Design of Stress Measurement System using Facial and Verbal Sentiment Analysis

표정과 언어 감성 분석을 통한 스트레스 측정시스템 설계

  • Yuw, Suhwa (Sookmyung Women's University Department of Computer Science) ;
  • Chun, Jiwon (Sookmyung Women's University Department of Computer Science) ;
  • Lee, Aejin (Sookmyung Women's University Department of Computer Science) ;
  • Kim, Yoonhee (Sookmyung Women's University Department of Computer Science)
  • Received : 2021.11.01
  • Accepted : 2021.12.12
  • Published : 2021.12.31
⟨ Previous Next ⟩

Abstract

Various stress exists in a modern society, which requires constant competition and improvement. A person under stress often shows his pressure in his facial expression and language. Therefore, it is possible to measure the pressure using facial expression and language analysis. The paper proposes a stress measurement system using facial expression and language sensitivity analysis. The method analyzes the person's facial expression and language sensibility to derive the stress index based on the main emotional value and derives the integrated stress index based on the consistency of facial expression and language. The quantification and generalization of stress measurement enables many researchers to evaluate the stress index objectively in general.

끊임없는 경쟁과 발전을 요구하는 현대사회에는 다양한 스트레스가 존재하고 그 스트레스는 많은 경우 인물의 표정과 언어로 표현된다. 따라서 스트레스는 표정과 언어 분석을 통하여 측정할 수 있으며, 이를 효율적으로 관리하기 위한 시스템 개발이 필요하다. 본 연구에서는 표정과 언어 감성 분석을 통하여 스트레스를 측정할 수 있는 시스템을 제안한다. 인물의 표정과 언어 감성을 분석하여 주요 감성값 기준으로 스트레스 지수를 도출하고 표정과 언어의 일치성을 기준으로 통합 스트레스 지수를 도출하는 스트레스 측정 방법을 제안한다. 스트레스 측정기법을 통한 정량화, 일반화는 다수의 연구자가 객관적인 기준으로 스트레스 지수를 평가할 수 있도록 할 수 있다.

Keywords

Acknowledgement

본 연구는 2021년도 정부(교육부)의 재원으로 한국과학창의재단(2021년도 학부생 연구 프로그램)의 지원을 받아 수행되었습니다.

References

  1. Gyeong Dae Ha, "Half of the people experienced depression and anxiety due to COVID-19...The biggest reason is poor sleep quality", medigatenews, 2021.7.29.
  2. Richard S. Lazarus, "Stress and Emotion : A New Synthesis," New York, Springer Publishing Company, pp.35-40, 2006.
  3. Aejin Lee, Jiwon Chun, Suhwa Yu, Yoonhee Kim, "An Integrated Stress Analysis System using Facial and Voice Sentiment," Annual Conference of KIPS 2021, Vol.28, No.2, Yeosu, Korea, 2021, pp.9-12.
  4. H. Gao, A. Yuce and J. Thiran, "Detecting emotional stress from facial expressions for driving safety," 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, pp.2-4, 2014.
  5. Daudelin-Peltier, C., Forget, H., Blais, C. et al, "The effect of acute social stress on the recognition of facial expression of emotions," Sci Rep 7, 2017.
  6. Sun Ju Sohn, Mi Sook Park, Jieun Park, Jin Hun Sohn, "Korean Emotion Vocabulary: Extraction and Categorization of Feeling Words," Science of Emotion & Sensibility, 15(1), pp.105-120, 2012.
  7. Verduyn, P., Lavrijsen, S., "Which emotions last longest and why: The role of event importance and rumination," Motiv Emot 39, pp.119-127, 2015. https://doi.org/10.1007/s11031-014-9445-y
  8. Rehman, Saqib & Hamza, Muhammad & Anum, Leena & Zaid, Farah & Khan, Ahmed hussain & Farooq, Zahida, "What if it is too negative? Managing emotions in the organization," Management Science Letters, pp.1489-1498, 2021.
  9. KNU Sentiment Dictionary https://github.com/park1200656/KnuSentiLex
  10. Gensim, Word2Vec https://radimrehurek.com/gensim/
  11. FaceAPI, Microsoft Azure https://www.azure.microsoft.com/en-us/services/cognitive-services/face/
  12. Eui Hwan Han, Hyung Tai Cha, "A Study of Emotional Dimension for Mixed Feelings,." Science of Emotion & Sensibility, Vol.16, No.4, pp 469-480, 2013
  13. B. Kim, S. Ryu, H. Oh, Y. Jeong, S. Kim and Y. Kim, "A Design of a Sentiment Analysis System using Data Similarity among SNS Big Data", Proc. of the KIISE Korea Computer Congress 2019, pp. 1581-1583, 2019. (in Korean)
  14. Google Cloud의 Speech-to-Text(STT) API https://cloud.google.com/speech-to-text?hl=ko
  15. Morpheme analyzer KOMORAN https://github.com/shineware/KOMORAN
  16. Hee-Won Shin, So-Jeong Lee, Gyu-Jin Son, Hye-Rin Kim, Seo-Hyun Gwak, Yeong-Min Kim, Yoonhee Kin, "A Design of Reliability Analysis System for Review Videos using the Integrated Analysis of Verbal and Nonverbal Sentiment," The KIPS Fall Conference 2020, Vol.27, No.2, pp.515-518, 2020.
  17. Yu-Jin Jeong, Eun Kyung Kim, "The Influence of Stress and Role Conflict on Quality of Life among Graduate Students in Nursing," The Korean Society of Stress Medicine STRESS, Vol.27, No.4, pp365~373, Dec. 2019. https://doi.org/10.17547/kjsr.2019.27.4.365
  18. https://www.youtube.com/watch?v=woBQb-wJr8o&list=PLVh3TM0B0Wtn0TYSjIPcyY7VSahjCgnXy
  19. https://www.youtube.com/watch?v=Kspm0GshF3A
  20. https://www.youtube.com/watch?v=Kspm0GshF3A
  21. https://www.youtube.com/watch?v=l6FxsZ24mkg
  22. https://www.youtube.com/watch?v=ea54mKRD2Ks
  23. https://www.youtube.com/watch?v=GxI3bbysXrc