Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Automatic Generation of Diverse Cartoons using User's Profiles and Cartoon Features

사용자 프로파일 및 만화 요소를 활용한 다양한 만화 자동 생성

  • 송인지 (연세대학교 컴퓨터과학과) ;
  • 정명철 (연세대학교 컴퓨터과학과) ;
  • 조성배 (연세대학교 컴퓨터과학과)
  • Published : 2007.05.15
Download PDF
⟨ Previous Next ⟩

Abstract

With the spread of Internet, web users express their daily life by articles, pictures and cartons to recollect personal memory or to share their experience. For the easier recollection and sharing process, this paper proposes diverse cartoon generation methods using the landmark lists which represent the behavior and emotional status of the user. From the priority and causality of each landmark, critical landmark is selected for composing the cartoon scenario, which is revised by story ontology. Using similarity between cartoon images and each landmark in the revised scenario, suitable cartoon cut for each landmark is composed. To make cartoon story more diverse, weather, nightscape, supporting character, exaggeration and animation effects are additionally applied. Through example scenarios and usability tests, the diversity of the generated cartoon is verified.

인터넷 이용의 확산과 함께 많은 사용자들이 자신의 일상을 글이나 사진, 만화와 같은 형태로 표현하여 과거의 기억을 반추하거나, 다른 사람과 공유하는 데 사용한다. 본 논문에서는 사용자의 일상 행동과 감정이 표현된 특이성 목록을 활용하여 다양한 만화를 생성함으로써 사용자의 기억이 쉽게 회상되고 공유될 수 있도록 하였다. 우선 각 특이성 별로 정의된 우선순위와 연관성을 바탕으로 중요 특이성을 선택하여 만화 시나리오를 구성하고, 생성된 시나리오를 스토리 온톨로지를 통해 보정한다. 다음 보정된 시나리오의 각 특이성과 만화 이미지 사이의 유사도를 계산하여, 각 특이성에 어울리는 만화 컷이 조합된다. 마지막으로 다양한 만화 생성을 위해 날씨, 야경, 과장, 애니메이션과 같은 효과들을 적용하였다. 생성된 만화의 다양성을 측정하기 위해 사용 시나리오와 사용성 평가를 통해 제안하는 방법을 평가하였다.

Keywords

References

  1. E. Tulving, Elements of Episodic Memory, Clarendon Press, 1983
  2. D. Griffiths, A. Dickinson, and N. Clayton, 'Episodic memory: What can animals remember about their past?' Trends in Congnitive Science, vol. 3, no. 2, pp. 74-80, 1999 https://doi.org/10.1016/S1364-6613(98)01272-8
  3. R. Miikkulainen, 'Script recognition with hierarchical feature maps,' Connection Science, vol. 2, pp. 83-101, 1990 https://doi.org/10.1080/09540099008915664
  4. R. Koster and W. Wright, A Theory of Fun for Game Design, Paraglyph Press, 2004
  5. K.-S. Hwang and S.-B. Cho, 'Modular Bayesian networks for inferring landmarks on mobile daily life,' Lecture Notes in Artificial Intelligence, 2006 https://doi.org/10.1007/11941439_100
  6. P. Korpipaa, J. Mantyjarvi, J. Kela, H. Keranen, and E. -J. Malrn, 'Managing context information in mobile devices,' IEEE Pervasive Computing, vol. 02, no. 3, pp. 42-51, 2003 https://doi.org/10.1109/MPRV.2003.1228526
  7. D. Patterson, L. Liao, D. Fox, and H. Kautz, 'Inferring high-level behavior from low-level sensors,' Proc. of the Fifth Int. Conf. on Ubiquitous Computing, pp. 73-89, Seattle, WA, October, 2003
  8. M. Raento, A. Oulasvirta, R. Petit, and H. Toivonen, 'ContextPhone: A prototyping platform for context-aware mobile applications,' IEEE Pervasive Computing, vol. 4, no. 2, pp. 51-59, 2005 https://doi.org/10.1109/MPRV.2005.29
  9. P. Korpipaa, M. Koskinen, J. Peltola, M. Satu-Marja, and T. Seppanen, 'Bayesian approach to sensor-based context awareness,' Personal and Ubiquitous Computing, vol. 7, pp. 113-124, 2003 https://doi.org/10.1007/s00779-003-0237-8
  10. S.-W. Lee, and K. Mase, 'Activity and location recognition using wearable sensors,' IEEE Pervasive Computing, vol. 1, issue 3, pp. 24-32, 2002 https://doi.org/10.1109/MPRV.2002.1037719
  11. J. Mantyjarvi, J. Himberg, and T. Seppanen, 'Recognizing human motion with multiple acceleration sensors,' IEEE Conf. on Systems, Man and Cybernetics, vol. 2, pp. 747-752, 2001 https://doi.org/10.1109/ICSMC.2001.973004
  12. E. Horvitz, C. M. Kadie, T. Paek, and D. Hovel, 'Models of attention in computing and communications: From principles to applications,' Communications of the ACM, vol. 46, no. 3, pp. 52-59, 2003 https://doi.org/10.1145/636772.636798
  13. E. Horvitz, S. Duamis, and P. Koch, 'Learning predictive models of memory landmarks,' 26th Annual Meeting of the Cognitive Science Society, August 2004
  14. W. W. Gibbs, 'Considerate computing,' Scientific American, pp. 54-61, Jan 2005
  15. M. Ringel, E. Curtrell, S. Dumais, and E. Horvitz, 'Milestones in time: The value of landmarks in retrieving information from personal stores,' 9th Int. Conf. on Human-Computer Interaction, 2003
  16. Y. Sumi, R. Sakamoto, K. Nakao and K. Mase, 'ComicDiary: Representing individual experiences in a comics style,' Ubicomp 2002, pp. 16-32, 2002
  17. D. Kurlander, T. Skellly, and D. Salesin, 'Comic Chat,' Proc. of SIGGRAPH'96, pp. 225-236, 1996
  18. P. Singh, B. Barry, and H. Liu, 'Teaching machines about everyday life,' BT Technology Journal, vol. 22, no. 4, pp. 227-240, 2004 https://doi.org/10.1023/B:BTTJ.0000047601.53388.74