Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

Emotion Prediction System using Movie Script and Cinematography

영화 시나리오와 영화촬영기법을 이용한 감정 예측 시스템

  • Kim, Jinsu (College of Ari Liberal Arts, Anyang University)
  • 김진수 (안양대학교 아리교양대학)
  • Received : 2018.10.11
  • Accepted : 2018.12.20
  • Published : 2018.12.28
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, we are trying to predict the emotion from various information and to convey the emotion information that the supervisor wants to inform the audience. In addition, audiences intend to understand the flow of emotions through various information of non-dialogue parts, such as cinematography, scene background, background sound and so on. In this paper, we propose to extract emotions by mixing not only the context of scripts but also the cinematography information such as color, background sound, composition, arrangement and so on. In other words, we propose an emotional prediction system that learns and distinguishes various emotional expression techniques into dialogue and non-dialogue regions, contributes to the completeness of the movie, and quickly applies them to new changes. The precision of the proposed system is improved by about 5.1% and 0.4%, and the recall is improved by about 4.3% and 1.6%, respectively, when compared with the modified n-gram and morphological analysis.

최근에 다양한 정보로부터 감정을 예측하여 청중에게 감독이 알리고자 하는 정보를 빠르게 전달하고자 한다. 또한, 청중은 감독의 의도를 대화 내용에 나타나는 대사뿐만 아니라, 영상내의 다양한 정보인 촬영 기법, 장면의 배경, 배경 음악 등을 통해 비대사 구간에서도 감정의 흐름을 이해하려고 한다. 본 논문에서는 대사와 같은 문맥의 상황뿐만 아니라, 촬영 영상에 담아낸 색상, 음향, 구도, 배치 등에 의해 표현된 정보를 혼합하여 감정을 추출하고자 한다. 즉, 다양한 감정 표현 기법을 대사 구간, 비대사 구간으로 나누어 학습하고 판별하여 영상의 완성도에 기여하고 새로운 변화에 빠르게 적용할 수 있는 감정 예측 시스템을 제안한다. 본 논문에서 제안한 감정 예측시스템이 변형된 n-gram 방식과 형태소 분석을 적용한 사례와 비교했을 때, 정확도는 약 5.1%, 0.4% 향상되었고, 재현율은 약 4.3%, 1.6% 향상되었다.

Keywords

OHHGBW_2018_v9n12_33_f0001.png 이미지

Fig. 1. Emotion Extract System Architecture

OHHGBW_2018_v9n12_33_f0002.png 이미지

Fig. 2. A part of tagging information from movie script(“Into the Woods”)

OHHGBW_2018_v9n12_33_f0003.png 이미지

Fig. 3. Example words and frequency for candidate keywords

OHHGBW_2018_v9n12_33_f0004.png 이미지

Fig. 4. Emotion Prediction from Movie Script

Table 1. Extracted Emotion Keywords

OHHGBW_2018_v9n12_33_t0001.png 이미지

Table 2. Recall and Precision of Each Emotion Prediction(%)

OHHGBW_2018_v9n12_33_t0002.png 이미지

References

  1. O S. Kim & S. W. Lee (2015). A Movie Recommendation Method based on Emotion Ontology, Journal of Korea Multimedia Society 18(9), 1068-1082. https://doi.org/10.9717/kmms.2015.18.9.1068
  2. Scherer, Klaus R & Paul Ekman. (2014). Approaches to Emotion, Psychology Press.
  3. D.L. McGuinness & F.V. Harmelen. (2004). OWL Web Ontology Language Overview, W3C Recommendation.
  4. KoNLPy, http://konlpy.org
  5. mecab-ko, https://bitbucket.org/eunjeon/mecab-ko
  6. NLTK, https://www.nltk.org/
  7. Bernhard E Boser, Isabelle M Guyon, & Vladimir N Vapnik. (1992). A Training Algorithm for Optimal Margin Classifiers, Proc. The Fifth Annual Workshop on Computational Learning Theory, 144-152.
  8. J. W. Han. (2011). Data Mining: Concepts and Techniques, Morgan Kaufmann.
  9. David Stump. (2014). Digital Cinematography: Fundamentals, Tools, Techniques, and Workflows, Routledge.
  10. Blain Brown. (2016). Cinematography: Theory and Practice: Image Making for Cinematographers and Directors, Routledge.
  11. Harry Box. (2013). Set Lighting Technician's Handbook: Film Lighting Equipment, Practice, and Electrical Distribution, Routledge.
  12. Manning, C. D, Raghavan, P & Schutze, H. (2009), Introduction to Information Retrieval, Cambridge University Press.
  13. J. S. Kim. (2014). Emotion Prediction of Document using Paragraph Analysis, Journal of Digital Convergence, 12(12), 249-255. DOI : 10.14400/JDC.2014.12.12.249
  14. IMSDb, http://www.imsdb.com
  15. R Baeza-Yates & B Ribeiro-Neto. (2004). Modern Information Retrieval: The Concepts and Technology behind Search, ACM Press New York.