Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Pupil Data Measurement and Social Emotion Inference Technology by using Smart Glasses

스마트 글래스를 활용한 동공 데이터 수집과 사회 감성 추정 기술

  • 이동원 ((주)스마트디아그노시스) ;
  • 문성철 (전주대학교 산업공학과) ;
  • 박상인 (한국과학기술연구원 바이오닉스연구단) ;
  • 김환진 ((주)스마트디아그노시스) ;
  • 황민철 (상명대학교 휴먼지능정보공학부)
  • Received : 2020.09.14
  • Accepted : 2020.10.22
  • Published : 2020.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study aims to objectively and quantitatively determine the social emotion of empathy by collecting pupillary response. 52 subjects (26 men and 26 women) voluntarily participated in the experiment. After the measurement of the reference of 30 seconds, the experiment was divided into the task of imitation and spontaneously self-expression. The two subjects were interacted through facial expressions, and the pupil images were recorded. The pupil data was processed through binarization and circular edge detection algorithm, and outlier detection and removal technique was used to reject eye-blinking. The pupil size according to the empathy was confirmed for statistical significance with test of normality and independent sample t-test. Statistical analysis results, the pupil size was significantly different between empathy (M ± SD = 0.050 ± 1.817)) and non-empathy (M ± SD = 1.659 ± 1.514) condition (t(92) = -4.629, p = 0.000). The rule of empathy according to the pupil size was defined through discriminant analysis, and the rule was verified (Estimation accuracy: 75%) new 12 subjects (6 men and 6 women, mean age ± SD = 22.84 ± 1.57 years). The method proposed in this study is non-contact camera technology and is expected to be utilized in various virtual reality with smart glasses.

본 연구에서는 동공 반응 데이터를 수집하여 공감의 사회 감성을 객관적이고 정량적으로 추정하는 데 목적이 있다. 52명(남 26명, 여 26명)의 피험자가 실험에 참여하였다. 실험은 30초의 참조 데이터 측정 후, 공감 유무에 따라 얼굴 표정 모방 과제와 자발적 표현과제로 구분되어 두 사람은 상호작용하였고 동공을 촬영하였다. 이진화 및 원형 윤곽선 검출법의 영상처리를 활용하여 동공 데이터를 수집하였고, 이상 데이터 제거 기법을 활용해 눈 깜빡임 노이즈를 제거하였다. 공감 유무에 따른 동공 크기 데이터는 정규성 검증 및 독립표본 t 검정을 통해 통계적 유의성을 확인하였다. 분석 결과, 공감하는 경우(M ± SD = 0.050 ± 1.817)와 공감하지 않은 경우(M ± SD = 1.659 ± 1.514) 동공 크기가 통계적으로 유의미한 차이를 보였다(t(92) = -4.629, p = 0.000). 판별분석을 통해 동공 크기에 따른 공감 유무를 추정하는 규칙을 정의하였고, 새로운 실험참가자 12명(남 6명, 여 6명, M ± SD = 22.84 ± 1.57세)을 대상으로 규칙을 검증(추정 정확도 75%)하였다. 본 연구에서 제안한 동공 크기 데이터를 이용한 공감의 사회 감성 추정 기술은 비접촉식 카메라 기반의 기술로 스마트 글래스와 접목되어 다양한 가상 현실 분야에 활용도가 높을 것으로 기대된다.

Keywords

Acknowledgement

서울시 산학연 협력사업(IC190023)

References

  1. J. Gratch, W. Mao, and S. Marsella, "Modeling social emotions and social attributions", Cambridge University Press, pp.219-251, 2006.
  2. P. Salovey, and J. D. Mayer, "Emotional intelligence. Imagination", cognition and personality, Vol.9, No.3, pp. 185-211, 1990, https://doi.org/10.2190/DUGG-P24E-52WK-6CDG (accessed Mar. 1, 1990).
  3. S. G. Barsade, "The ripple effect: Emotional contagion in groups", Yale SOM Working Paper, No.OB-01, 2000, http://dx.doi.org/10.2139/ssrn.250894 (accessed Jul. 30, 2001).
  4. R. A. Baron, "The sweet smell of... helping: Effects of pleasant ambient fragrance on prosocial behavior in shopping malls", Personality and Social Psychology Bulletin, Vol.23, No.5, pp. 498-503, 1997, https://doi.org/10.1177/0146167297235005 (accessed May. 1, 1997).
  5. L. Steinberg, S. D. Lamborn, N. Darling, N. S. Mounts, and S. M. Dornbusch, "Over‐time changes in adjustment and competence among adolescents from authoritative, authoritarian, indulgent, and neglectful families", Child development, Vol.65, No.3, pp. 754-770, 1994, https://doi.org/10.1111/j.1467-8624.1994.tb00781.x (accessed Jun. 1994).
  6. L. Tarassenko, M. Villarroel, A. Guazzi, J. Jorge, D. A. Clifton, and C. Pugh, "Non-contact video-based vital sign monitoring using ambient light and auto-regressive models", Physiological measurement, Vol.35, No.5, 807, 2014, https://doi.org/10.1088/0967-3334/35/5/807 (accessed Mar. 28, 2014).
  7. W. Boucsein, and R. W. Backs, "The psychophysiology of emotion, arousal, and personality: Methods and models", Handbook of digital human modeling: Research for applied ergonomics and human factors engineering, 35, 2009.
  8. S. W. Porges, "Orienting in a defensive world: Mammalian modifications of our evolutionary heritage. A polyvagal theory", Psychophysiology, Vol.32, No.4, pp. 301-318, 1995, https://doi.org/10.1111/j.1469-8986.1995.tb01213.x (accessed Mar. 23, 1995).
  9. R. McCraty, M. Atkinson, D. Tomasino, and R. T. Bradley, "The Coherent Heart Heart-Brain Interactions, Psychophysiological Coherence, and the Emergence of System-Wide Order", Integral Review: A Transdisciplinary & Transcultural Journal for New Thought, Research, & Praxis, Vol. 5, No.2, 2009.
  10. E. H. Hess, and J. M. Polt, "Pupil size in relation to mental activity during simple problem-solving", Science, Vol.143, No.3611, pp. 1190-1192, 1964, https://doi.org/10.1126/science.143.3611.1190 (accessed Mar. 13, 1964).
  11. D. Kahneman, and J. Beatty, "Pupil diameter and load on memory", Science, Vol.154 No.3756, pp. 1583-1585, 1966, https://doi.org/10.1126/science.154.3756.1583 (accessed Dec. 23, 1966).
  12. M. M. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, "The pupil as a measure of emotional arousal and autonomic activation", Psychophysiology, Vol.45, No.4, pp. 602-607, 2008, https://doi.org/10.1111/j.1469-8986.2008.00654.x (accessed May. 22, 2008).
  13. J. Lee, K. Suh, and S. Nam, "C-P-N-D Ecosystem-based Broadcasting/Media Virtual Reality (VR) Prospects", Journal of Broadcast Engineering, Vol.23, No.1, pp. 19-25, 2018, https://doi.org/10.5909/JBE.2018.23.1.19 (accessed Oct. 11, 2018).
  14. S. Mun, M. Whang, S. Park, D. W. Lee, and H. I. Kim, "Overview of VR Media Technology and Methods to Reduce Cybersickness" Journal of Broadcast Engineering, Vol.23, No.6, pp. 800-812, 2018, https://doi.org/10.5909/JBE.2018.23.6.800 (accessed Oct. 16, 2018).
  15. M. M. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, "The pupil as a measure of emotional arousal and autonomic activation", Psychophysiology, Vol.45, No.4, pp. 602-607, 2008, https://doi.org/10.1111/j.1469-8986.2008.00654.x (accessed May. 22, 2008).
  16. P. Ekman, "An argument for basic emotions", Cognition & emotion, Vol.6, No.3-4, pp. 169-200, 1992, https://doi.org/10.1080/02699939208411068 (accessed Jan. 7, 2008).
  17. E. Hatfield, J. T. Cacioppo, and R. L. Rapson, "Emotional contagion", Current directions in psychological science, Vol.2, No.3, pp. 96-100, 1993, https://doi.org/10.1111/1467-8721.ep10770953 (accessed Jun. 1, 1993).
  18. G. Rizzolatti, and L. Craighero, "The mirror-neuron system", Annual Review of Neuroscience, Vol.27, pp. 169-192, 2004, https://doi.org/10.1146/annurev.neuro.27.070203.144230 (accessed Jul. 21, 2004).
  19. E. C. Lee, K. R. Park, M. Whang, and K. Min, "Measuring the degree of eyestrain caused by watching LCD and PDP devices", International Journal of Industrial Ergonomics, Vol.39, No.5, pp. 798-806, 2009, https://doi.org/10.1016/j.ergon.2009.02.008 (accessed Mar. 18, 2009)
  20. S. W. Huck, W. H. Cormier, and W. G. Bounds, "Reading statistics and research", New York: Harper & Row, pp. 74-102, 1974.
  21. S. D. Preston, and F. B. De Waal, "Empathy: Its ultimate and proximate bases", Behavioral and brain sciences, Vol.25, No.1, pp. 1-20, 2002, https://doi.org/10.1017/S0140525X02000018 (accessed Jan. 23, 2003).
  22. G. Bohner, and T. Weinerth, "Negative affect can increase or decrease message scrutiny: The affect interpretation hypothesis", Personality and Social Psychology Bulletin, Vol.27, No.11, pp. 1417-1428, 2001, https://doi.org/10.1177/01461672012711003 (accessed Nov. 1, 2001).