Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

IMToon: Image-based Cartoon Authoring System using Image Processing

IMToon: 영상처리를 활용한 영상기반 카툰 저작 시스템

  • Seo, Banseok (Department of Software, Catholic University of Pusan) ;
  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 서반석 (부산가톨릭대학교 소프트웨어학과) ;
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2017.03.05
  • Accepted : 2017.05.30
  • Published : 2017.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes IMToon(IMage-based carToon) which is an image-based cartoon authoring system using an image processing algorithm. The proposed IMToon allows general users to easily and efficiently produce frames comprising cartoons based on image. The authoring system is designed largely with two functions: cartoon effector and interactive story editor. Cartoon effector automatically converts input images into a cartoon-style image, which consists of image-based cartoon shading and outline drawing steps. Image-based cartoon shading is to receive images of the desired scenes from users, separate brightness information from the color model of the input images, simplify them to a shading range of desired steps, and recreate them as cartoon-style images. Then, the final cartoon style images are created through the outline drawing step in which the outlines of the shaded images are applied through edge detection. Interactive story editor is used to enter text balloons and subtitles in a dialog structure to create one scene of the completed cartoon that delivers a story such as web-toon or comic book. In addition, the cartoon effector, which converts images into cartoon style, is expanded to videos so that it can be applied to videos as well as still images. Finally, various experiments are conducted to verify the possibility of easy and efficient production of cartoons that users want based on images with the proposed IMToon system.

본 연구는 영상처리 알고리즘을 활용하여 영상 기반의 카툰을 제작하는 저작 시스템인 IMToon(IMage-based carToon)을 제안한다. 제안하는 IMToon은 영상을 기반으로 하여 일반 사용자들도 쉽고 효율적으로 카툰을 구성하는 프레임들을 제작할 수 있도록 한다. 이를 위해 저작시스템을 크게 카툰 이펙터와 대화형 이야기 편집기의 두 기능으로 나누어 설계한다. 카툰 이펙터는 입력 영상을 카툰 형식의 영상으로 자동 변환하는 기능으로 영상기반 카툰 쉐이딩과 윤곽 드로잉의 단계로 진행된다. 영상기반 카툰 쉐이딩은 사용자로부터 원하는 장면의 사진을 입력으로 받아 입력 사진의 컬러 모델에서 명암 정보를 분리하고, 원하는 단계의 음영대로 단순화하여 카툰 형식의 영상으로 생성하는 방법이다. 그리고 테두리 검출을 통해 쉐이딩된 영상에 윤곽선을 적용시키는 윤곽 드로잉 단계를 거쳐 최종적으로 카툰 형식의 영상을 생성한다. 대화형 이야기 편집기는 웹툰이나 만화책과 같이 이야기를 전달하는 완성된 카툰의 한 장면을 생성하기 위하여 말풍선과 자막 등을 대화형 구조로 입력하는 기능이다. 여기에 단일 영상을 카툰방식으로 변환하는 카툰 이펙터를 비디오로 확장시켜 정지 영상 뿐 아니라 동영상에도 응용할 수 있도록 설계한다. 마지막으로 제안한 IMToon 시스템을 통해 사용자가 원하는 카툰을 영상을 기반으로 보다 쉽고 효율적으로 제작할 수 있는지 여부를 다양한 실험을 통해 확인한다.

Keywords

Acknowledgement

Supported by : 한국연구재단

References

  1. S. C. Hsu and I. H. H. Lee, "Drawing and animation using skeletal strokes," in Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '94. New York, NY, USA: ACM, 24-29 July 1994, pp. 109-118. [Online]. Available: http://doi.acm.org/10.1145/192161.192186
  2. J. D. Northrup and L. Markosian, "Artistic silhouettes: A hybrid approach," in Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering, ser. NPAR '00. New York, NY, USA: ACM, 5-7 June 2000, pp. 31-37. [Online]. Available: http://doi.acm.org/10.1145/340916.340920
  3. F. Durand, V. Ostromoukhov, M. Miller, F. Duranleau, and J. Dorsey, "Decoupling strokes and highlevel attributes for interactive traditional drawing," in Proceedings of the 12th Eurographics Workshop on Rendering Techniques. London, UK, UK: Springer-Verlag, 25-27 June 2001, pp. 71-82. [Online]. Available: http://dl.acm.org/citation.cfm?id=647653.732296
  4. M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin, "Orientable textures for image-based pen-and-ink illustration," in Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '97. New York, NY, USA: ACM Press/Addison-Wesley Publishing Co., 3-8 August 1997, pp. 401-406. [Online]. Available: http://dx.doi.org/10.1145/258734.258890
  5. F. V. Reeth, "Integrating 2 $\frac{1}{2}d$ computer animation techniques for supporting traditional animation," in Computer Animation '96. Proceedings, Jun 3-4 June 1996, pp. 118-125.
  6. Z. Ruttkay and H. Noot, "Animated chartoon faces," in In the first international symposium on Non-photorealistic animation and rendering 2000, 5-7 June 2000, pp. 91-100.
  7. H. Chen, N.-N. Zheng, L. Liang, Y. Li, Y.-Q. Xu, and H.-Y. Shum, "Pictoon: A personalized image-based cartoon system," in Proceedings of the Tenth ACM International Conference on Multimedia, ser. MULTIMEDIA '02. New York, NY, USA: ACM, 1-6 December 2002, pp. 171-178. [Online]. Available: http://doi.acm.org/10.1145/641007.641040
  8. A. Lake, C. Marshall, M. Harris, and M. Blackstein, "Stylized rendering techniques for scalable real-time 3d animation," in Proceedings of the 1st International Symposium on Nonphotorealistic Animation and Rendering, ser. NPAR '00. New York, NY, USA: ACM, 5-7 June 2000, pp. 13-20. [Online]. Available: http://doi.acm.org/10.1145/340916.340918
  9. A. Gooch, B. Gooch, P. Shirley, and E. Cohen, "A non-photorealistic lighting model for automatic technical illustration," in Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '98. New York, NY, USA: ACM, 19-24 July 1998, pp. 447-452. [Online]. Available: http://doi.acm.org/10.1145/280814.280950
  10. P.-P. J. Sloan, W. Martin, A. Gooch, and B. Gooch, "The lit sphere: A model for capturing npr shading from art," in Proceedings of Graphics Interface 2001, ser. GI '01. Toronto, Ont., Canada, Canada: Canadian Information Processing Society, 7-9 June 2001, pp. 143-150. [Online]. Available: http://dl.acm.org/citation.cfm?id=780986.781004
  11. K.-i. Anjyo and K. Hiramitsu, "Stylized highlights for cartoon rendering and animation," IEEE Comput. Graph. Appl., vol. 23, no. 4, pp. 54-61, July 2003. [Online]. Available: http://dx.doi.org/10.1109/MCG.2003.1210865
  12. P. Barla, J. Thollot, and L. Markosian, "X-toon: An extended toon shader," in Proceedings of the 4th International Symposium on Non-photorealistic Animation and Rendering, ser. NPAR '06. New York, NY, USA: ACM, 5-7 June 2006, pp. 127-132. [Online]. Available: http://doi.acm.org/10.1145/1124728.1124749
  13. A. Selle, A. Mohr, and S. Chenney, "Cartoon rendering of smoke animations," in Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, ser. NPAR '04. New York, NY, USA: ACM, 7-9 June 2004, pp. 57-60. [Online]. Available: http://doi.acm.org/10.1145/987657.987666
  14. J. Shin, M. Haller, and R. Mukundan, "A stylized cartoon hair renderer," in Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ser. ACE '06. New York, NY, USA: ACM, 14-16 June 2006. [Online]. Available: http://doi.acm.org/10.1145/1178823.1178899
  15. A. Bousseau, J. P. O'shea, F. Durand, R. Ramamoorthi, and M. Agrawala, "Gloss perception in painterly and cartoon rendering," ACM Trans. Graph., vol. 32, no. 2, pp. 18:1-18:13, Apr. 2013. [Online]. Available: http://doi.acm.org/10.1145/2451236.2451244
  16. Q. Xu, Y. Gingold, and K. Singh, "Inverse toon shading: Interactive normal field modeling with isophotes," in Proceedings of the Workshop on Sketch-Based Interfaces and Modeling, ser. SBIM '15. Aire-la-Ville, Switzerland, Switzerland: Eurographics Association, 20-22 June 2015, pp. 15-25. [Online]. Available: http://dl.acm.org/citation.cfm?id=2810210.2810212
  17. A. Hertzmann, "Painterly rendering with curved brush strokes of multiple sizes," in Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '98. New York, NY, USA: ACM, 19-24 July 1998, pp. 453-460. [Online]. Available: http://doi.acm.org/10.1145/280814.280951
  18. H. Winnemoller, S. C. Olsen, and B. Gooch, "Realtime video abstraction," ACM Trans. Graph., vol. 25, no. 3, pp. 1221-1226, jul 2006. [Online]. Available: http://doi.acm.org/10.1145/1141911.1142018
  19. X. Mao, Y. Nagasaka, and A. Imamiya, "Automatic generation of pencil drawing using lic," in ACM SIGGRAPH 2002 Conference Abstracts and Applications, ser. SIGGRAPH '02. New York, NY, USA: ACM, 21-26 July 2002, pp. 149-149. [Online]. Available: http://doi.acm.org/10.1145/1242073.1242162
  20. H. Johan, R. Hashimoto, and T. Nishita, "Creating watercolor style images taking into account painting techniques," The Journal of the Society for Art and Science, vol. 3, no. 4, pp. 207-215, 2004. https://doi.org/10.3756/artsci.3.207
  21. J. Fischer and D. Bartz, "Real-time cartoon-like stylization of ar video streams on the gpu," Technical Report WSI-2005-18, Wilhelm Schickard Institute for Computer-Science, WSI/GRIS, 2005. [Online]. Available: http://nbnresolving.de/urn:nbn:de:bsz:21-opus-19870
  22. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proceedings of the Sixth International Conference on Computer Vision, ser. ICCV '98. Washington, DC, USA: IEEE Computer Society, 4-7 January 1998, pp. 839-846. [Online]. Available: http://dl.acm.org/citation.cfm?id=938978.939190
  23. L. Jing, K. Inoue, and K. Urahama, "Illustrations generated by anisotropic smoothing of self-quotient images," Abstracts of IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences, vol. J89-A, no. 5, pp. 385-386, 2006.
  24. A. A. Abdulmunen, "Converting color real image to cartoon image using non-parametric mean-shift technique," journal of kerbala university, vol. 10, no. 2, pp. 44-54, 2012.
  25. J. Wang, Y. Xu, H.-Y. Shum, and M. F. Cohen, "Video tooning," ACM Trans. Graph., vol. 23, no. 3, pp. 574-583, Aug. 2004. [Online]. Available: http://doi.acm.org/10.1145/1015706.1015763
  26. B.-K. Chun, D.-S. Ryu, W.-I. Hwang, and H.-G. Cho, "An automated procedure for word balloon placement in cinema comics," in Proceedings of the Second International Conference on Advances in Visual Computing-Volume Part II, ser. ISVC'06. Berlin, Heidelberg: Springer-Verlag, 2006, pp. 576-585. [Online]. Available: http://dx.doi.org/10.1007/11919629 58
  27. H. Wakama and H. Katayose, "Takumi: A real-time video converter that generates cartoon-style animated images using depth map," in Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, ser. ACE '11. New York, NY, USA: ACM, 8-11 November 2011, pp. 61:1-61:7. [Online]. Available: http://doi.acm.org/10.1145/2071423.2071500
  28. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, June 1986. [Online]. Available: http://dx.doi.org/10.1109/TPAMI.1986.4767851
  29. D. Ryu, B. Chun, K. Park, and H. Cho, "Automated Generation of Word Balloons in Comics," Journal of the Korea Computer Graphics Society, vol. 13, pp. 33-36, 2007. [Online]. Available: http://www.dbpia.co.kr/Article/NODE01968667 https://doi.org/10.15701/kcgs.2007.13.1.33