KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Multi-Layered Framework for color pastel painting

  • Yang, Heekyung (Dept. of Computer Science, Graduate School, Sangmyung Univ.) ;
  • Min, Kyungha (Dept. of Computer Science, Sangmyung Univ.)
  • Received : 2016.11.03
  • Accepted : 2017.03.14
  • Published : 2017.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

We present a computerized framework for producing color pastel painting from the visual information extracted from a photograph. To express color pastel painting, we propose a multi-layered framework where each layer possesses pastel stroke patterns of different colors. The stroke patterns in the separate layers are merged by a rendering equation based on a participating media rendering scheme. To produce the stroke patterns in each layer, we review the physical properties of pastels and the mechanism of a convolution framework, which is the most widely used scheme to simulate stick-shaped media such as pencils. We devise the following computational models to extend the convolution framework to produce pastel strokes: a bold noise model, which mimics heavy and clustered deposition of pigment, and a thick convolution filter model, which produces various pastel stroke patterns. We also design a stochastic color coordination scheme to mimic pastel artists' color expression and to separate strokes in different layers. To demonstrate the soundness of approach, we conduct several experiments using the models and compare the results with existing works or real pastel paintings. We present the results for several pastel paintings to demonstrate the excellent performance of our framework.

Keywords

References

  1. H. Jensen and P. Christensen, "Efficient simulation of light transport in scenes with participating media using photon maps," in Proc. of Siggraph 98, pp. 311-320, 1998.
  2. H. Kang, S. Lee and C. Chui, "Flow-based image abstraction," IEEE TVCG 15, 1, pp. 62-76, 2009.
  3. S. Takagi, I. Fujishiro and M. Nakajimam, "Volumetric modeling of colored pencil drawing," in Proc. of Pacific Graphics 99, pp. 250-258, 1999.
  4. M. C. Sousa and J. Buchanan, "Computer-generated graphite pencil rendering of 3d polygonal models," in Proc. of Eurographics 99, pp. 195-207, 1999.
  5. M. C. Sousa and J. Buchanan, "Observational model of blenders and erasers in computer- generated pencil rendering," in Proc. of Grapics Interface 99, pp. 157-166, 1999.
  6. K. Murakami, R. Tsuruno and E. Genda, "Multiple illuminated paper textures for drawing strokes," in Proc. of Computer Graphics International 05, pp. 156-161, 2005.
  7. D. Rudolf, D. Mould and E. Neufeld, "A bidirectional deposition model of wax crayons," Comp. Graph. Forum vol. 24, no. 1, pp. 27-39, 2005. https://doi.org/10.1111/j.1467-8659.2005.00826.x
  8. C. S. Haase and G. W. Meyer, "Modeling pigmented materials for realistic image synthesis," ACM TOG, vol. 11, no.4, pp. 305-335, 1992. https://doi.org/10.1145/146443.146452
  9. B. Cabral and C. Leedom, "Imaging vector field using line integral convolution," in Proc. of Siggraph 93, pp. 263-270, 1993.
  10. X. Mao, Y. Nagasaka and A. Imamiya, "Automatic generation of pencil drawing using lic," in Proc. of ACM Siggraph 2002 Conference Abstractions and Applications, 149, 2002.
  11. S. Yamamoto, X. Mao and A. Imamiya, "Colored pencil filter with custom colors," in Proc. of Pacific Graphics 04, pp. 329-338, 2004.
  12. S. Yamamoto, X. Mao and A. Imamiya, "Enhanced lic pencil filter," in Proc. of the International Conference on Computer Graphics, Imaging and Visualization 04, pp. 251-256, 2004.
  13. H. Yang and K. Min, "Feature-guided convolution for pencil rendering," KSII Trans. on Internet and Information Systems, vol. 5, no. 7, pp. 1311-1328, 2011. https://doi.org/10.3837/tiis.2011.07.006
  14. H. Yang, Y. Kwon and K. Min, "A Stylized Approach for Pencil Drawing from Photographs," Computer Graphics Forum 31(4), 1471-1480, 2012. https://doi.org/10.1111/j.1467-8659.2012.03143.x
  15. Y. Kwon, H. Yang and K. Min, "Pencil rendering on 3d meshes using convolution," Comp. & Graph. vol. 36, no. 8, pp. 930-944, 2012. https://doi.org/10.1016/j.cag.2012.08.002
  16. M. Hata, M. Toyoura and X. Mao, "Automatic generation of accentuated pencil drawing with saliency map and lic," Vis. Comp. vol. 28, no. 6-8, pp. 657-668, 2012. https://doi.org/10.1007/s00371-012-0689-9
  17. H. Matsui, H. Johan and T. Nishita, "Creating colored pencil images by drawing strokes based on boundaries of regions," in Proc. of Computer Graphics International 05, pp. 148-155, 2005.
  18. H. Lee, S. Kwon and S. Lee, "Real-time pencil rendering," in Proc. of NPAR 06, vol. 4, no. 8, pp. 37-45, 2006.
  19. Y. Kim, J. Yu, H. Yu and S. Lee, "Line-art illustration of dynamic and specular surfaces," ACM ToG, vol. 27, no. 5, 156, 2008.
  20. C. Lu, L. Xu and J. Jia, "Combining sketch and tone for pencil drawing production," in Proc. of NPAR 2012, pp. 65-73, 2012.
  21. A. Hertzmann, C. Jacobs, N. Oliver and B. Curless, "Image analogies," in Proc. of Siggraph 01, pp. 327-340, 2001.
  22. L. Gatys, A. Ecker and M. Bethge, "Image style transfer using convolutional neural networks," in Proc. of CVPR 16, pp. 2414-2423, 2016.
  23. A. Selim, M. Elgharib and L. Doyle, "Painting style transfer for head portraits using convolutional neural networks," ACM ToG vol. 35, no. 4, 129, 2016.
  24. L. Lin, K. Zeng, H. Lv, Y. Wang, Y. Xu and S. Zhu, "Painterly animation using video semantics and feature correspondence," in Proc. of NPAR 10, pp. 73-80, 2010.
  25. J. Hays and I. Essa, "Image and video-based painterly animation," in Proc. of NPAR 04, pp. 113-120, 2004.
  26. Z. Chen, B. Kim, D. Ito, H. Wang, "Wetbrush: Gpu-based 3d painting simulation at the bristle level," ACM ToG, vol. 34, no. 6, 200, 2015.