Journal of the Architectural Institute of Korea Planning & Design (대한건축학회논문집:계획계)

Architectural Institute of Korea (대한건축학회)
권호 표지
DOI QR코드

DOI QR Code

An EEG-based Deep Neural Network Classification Model for Recognizing Emotion of Users in Early Phase of Design

초기설계 단계 사용자의 감정 인식을 위한 뇌파기반 딥러닝 분류모델

  • 장선우 (한양대학교 대학원 건축학과) ;
  • 동원혁 (한양대학교 대학원 건축학과) ;
  • 전한종 (한양대 건축학부)
  • Received : 2018.09.27
  • Accepted : 2018.11.16
  • Published : 2018.12.30
⟨ Previous Next ⟩

Abstract

The purpose of this paper was to propose a model that recognizes potential users' emotional response toward design by classifying Electroencephalography(EEG). Studies in neuroscience and psychology have made an effort to recognize subjects' emotional response by analyzing EEG data. And this approach has been adopted in design since it is critical to monitor users' subjective response in the preface of design. Moreover, the building design process cannot be reversed after construction, recognizing clients' affection toward design alternatives plays important role. An experiment was conducted to record subjects' EEG data while they view their most/least liked images of small-house designs selected by them among the eight given images. After the recording, a subjective questionnaire, PANAS, was distributed to the subjects in order to describe their own affection score in quantitative way. Google TensorFlow was used to build and train the model. Dataset for model training and testing consist of feature columns for recorded EEG data and labels for the questionnaire results. After training and testing, the measured accuracy of the model was 0.975 which was higher than the other machine learning based classification methods. The proposed model may suggest one quantitative way of evaluating design alternatives. In addition, this method may support designer while designing the facilities for people like disabled or children who are not able to express their own feelings toward alternatives.

Keywords

Acknowledgement

Supported by : 한국연구재단

References

  1. Lertlakkhanakul, J., Choi, J. W., & Kim, M. Y. (2008). Building data model and simulation platform for spatial interaction management in smart home, Automation in Construction, 17(8), 948-957 https://doi.org/10.1016/j.autcon.2008.03.004
  2. Shen, W., Shen, Q., & Xiaoling, Z. (2012). A user pre-occupancy evaluation method for facilitating the designer-client communication, Facilities, 30(7/8), 302-3723 https://doi.org/10.1108/02632771211220103
  3. Kiviniemi, A. (2005). Requirements management interface to building product models, Thesis, Standford University
  4. Eastman, C. (1975). The Use of Computers Instead of Drawings in Building Design, AIA Journal, 63(3), 46-50
  5. Schomer, D., & Silva, F. (2010). Niedermeyer's Electroencephalography: Basic Principles, Clinical Applications, and Related Fields Sixth Edition, LWW
  6. Ekman, P., & Friesen, W. V. (1971). CONSTANTS ACROSS CULTURES IN THE FACE AND EMOTION, Journal of Personality and Social Psychology, 124-129
  7. Pan, L., Lian, Z., & Lan, L. (2011). Investigation of Gender Differences in Sleeping Comfort at Different Environmental Temperatures, Building and Environment, 21(6), 811-820
  8. Lan, L., Pan, L., Lian, Z., Huang, H., & Lin, Y. (2013). Experimental study on thermal comfort of sleeping people at different air temperatures, Building and Environment, 73, 24-31
  9. Lan, L, Lian, Z., & Lin, Y. (2016). Comfortably cool bedroom environment during the initial phase of the sleeping period delays the onset of sleep in summer, Building and Environment, 103, 36-43 https://doi.org/10.1016/j.buildenv.2016.03.030
  10. Lan, L., & Lian, Z. (2009). Use of neurobehavioral tests to evaluate the effects of indoor environment quality on productivity, Building and Environment, 44(11), 2208-2217 https://doi.org/10.1016/j.buildenv.2009.02.001
  11. Lee, H. J., Choi, Y. L., & Chun, C. Y. (2012). Effect of Indoor Air Temperature on the Occupants' Attention Ability based on Electroencephalogram Analysis, JOURNAL OF THE ARCHITECTURAL INSTITUTE OF KOREA Planning & Design, 28(3), 217-225 https://doi.org/10.5659/JAIK_PD.2012.28.3.217
  12. Zhang, F., Haddad, S., Nakisa, B., Rastgoo, M. N., Candido, C., Tjondronegoro, D., & Dear, R. D. (2017). The effects of higher temperature setpoints during summer on office workers' cognitive load and thermal comfort, Building and Environment, 123, 176-188 https://doi.org/10.1016/j.buildenv.2017.06.048
  13. Hwang, Y. S., Kim, S. Y., & Kim, J. Y. (2013). An Analysis of Youth EEG based on the Emotional Color Scheme Images by Different Space of Community Facilities, Journal of Korean Institute of Interior Designs, 22(5), 171-178 https://doi.org/10.14774/JKIID.2013.22.5.171
  14. Hwang, Y. S., Kim, J. Y., Chang, A. L., Lim, E. Y., & Jung, H. W. (2014). Planning of Apartment Community Facilities according to EEG Analysis by School Age of Youth Emotional Words, Journal of Korean Institute of Interior Designs, 23(4), 181-189
  15. Ryu, J. S., & Lee, J. S. (2015). Correlation Analysis of Emotional Adjectives and EEG to Apply Color to the Indoor Living Space, Journal of Korea Society of Color Studies, 29(3), 25-35
  16. Kim, J. H., Kim, J. Y., & Kim, S. H. (2016). A Study on the Attention Concentration Properties in Convergent Exploration Situations in Cafe Space, Journal of the Korean Institute of Interior Design, 25(2), 30-40 https://doi.org/10.14774/JKIID.2016.25.2.030
  17. Schwartz, G., Davidson, R., & Maer, F. (1975). Right hemisphere lateralization for emotion in the human brain: Interactions with cognition, Science, 190, 286-288 https://doi.org/10.1126/science.1179210
  18. Russell, J. (1980), A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161-1178 https://doi.org/10.1037/h0077714
  19. Watson, D., Clark, L., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales., Journal of Personality and Social Psychology, 54(6), 1063-1070 https://doi.org/10.1037/0022-3514.54.6.1063
  20. Watson, D., & Clark, L. (1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule - Expanded Form, Department of Psychological & Brain Sciences Publications
  21. Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks, Science, 313, 504-507 https://doi.org/10.1126/science.1127647
  22. Zipggumigi (2018). One-room & Officetel interior, Offficetel interior Three months after independent, Make my own homely place., Retrived September 27, 2018 from https://m.post.naver.com/viewer/postView.nhn?volumeNo=15973973&memberNo=403647
  23. Zipggumigi (2018). One-room & Officetel interior, Offficetel interior First time, unfamilar but quite expected my own nest, Retrived September 27, 2018 from https://m.post.naver.com/viewer/postView.nhn?volumeNo=15973973&memberNo=403647
  24. The artist magazine (2018). Your dream home, Home interior, Pretty space interior that can be applied to one-room less than 10 pyeong, Retrived September 27, 2018, from https://post.naver.com/viewer/postView.nhn?volumeNo=15611385
  25. Today's house (2018). Today's house self-interior, 12 pyeong officetel with Storage&mood #A small house of 10 pyeong, Retrived September 27, 2018 from https://post.naver.com/viewer/postView.nhn?volumeNo=13773592
  26. EMOTIV (2018). EMOTIV EPOC+, EPOC+ Headset Details, Retrieved September 27, 2018 from https://emotiv.gitbooks.io/epoc-user-manual/content/epoc+_headset_details/
  27. Liu, Y., Jiang, X., Cao, T., Wan, F. U., Mak, P., & Vai, M. (2012). Implementation of SSVEP based BCI with Emotiv EPOC, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings, 34-37
  28. Crawford, J., & Henry, J. (2010). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample, British Journal of Clinical Psychology, 43(3), 245-265 https://doi.org/10.1348/0144665031752934
  29. TensorFlow (2018). Retrieved September 27, 2018 from https://www.tensorflow.org/