Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A DoF-Based Efficient Image Abstraction

피사계 심도를 고려한 효율적인 이미지 추상화

  • Received : 2018.04.23
  • Accepted : 2018.09.27
  • Published : 2018.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we present a non-photorealistic rendering technique that automatically delivers a stylized abstraction of a photograph with DoF(Depth of field). Our approach is a new filtering method that efficiently classifies DoF regions using RGB channels and automatically adjusts the color abstraction and extracted line quality based on this classification. This DoF-based filtering is simple, fast, and easy to implement and significantly improves the abstraction performance in terms of feature enhancement and stylization.

본 논문에서는 피사계 심도(DoF, Depth of field)가 포함된 사진을 자동으로 추상화 시켜주는 비 사실적 렌더링(NPR, Non-photorealistic rendering) 기술을 제안한다. 우리의 접근 방식은 RGB 채널을 이용하여 DoF 영역을 효율적으로 분류하고, DoF 크기에 따라 색상을 추상화하며, 라인의 두께를 자동으로 조절함으로 새롭게 필터링 하는 기술이다. DoF기반 필터링 방식은 성능과 디자인 관점에서 추상화의 품질을 크게 개선시켰으며, 간단하고 빨라 구현하기 쉽고, 사진으로부터 추상화나 일러스트레이션을 제작할 때 원본 사진이 갖고 있는 DoF의 특징과 스타일을 효율적으로 잘 표현한다.

Keywords

References

  1. D. DeCarlo, A. Finkelstein, S. Rusinkiewicz, and A. Santella, "Suggestive contours for conveying shape," ACM Transactions on Graphics (TOG), vol. 22, no. 3, pp. 848-855, 2003. https://doi.org/10.1145/882262.882354
  2. R. D. Kalnins, P. L. Davidson, L. Markosian, and A. Finkelstein, "Coherent stylized silhouettes," in ACM Transactions on Graphics, vol. 22, no. 3, 2003, pp. 856-861. https://doi.org/10.1145/882262.882355
  3. M. C. Sousa and P. Prusinkiewicz, "A few good lines: Suggestive drawing of 3d models," in Computer Graphics Forum, vol. 22, no. 3, 2003, pp. 381-390. https://doi.org/10.1111/1467-8659.00685
  4. T. Isenberg, B. Freudenberg, N. Halper, S. Schlechtweg, and T. Strothotte, "A developer's guide to silhouette algorithms for polygonal models," IEEE Computer Graphics and Applications, vol. 23, no. 4, pp. 28-37, 2003. https://doi.org/10.1109/MCG.2003.1210862
  5. P. Litwinowicz, "Processing images and video for an impressionist effect," in Proceedings of the 24th annual conference on Computer graphics and interactive techniques, 1997, pp. 407-414.
  6. A. Hertzmann, "Painterly rendering with curved brush strokes of multiple sizes," in Proceedings of the 25th annual conference on Computer graphics and interactive techniques, 1998, pp. 453-60.
  7. B. Gooch, G. Coombe, and P. Shirley, "Artistic vision: painterly rendering using computer vision techniques," in Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, 2002, pp. 83-ff.
  8. J. Hays and I. Essa, "Image and video based painterly animation," in Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, 2004, pp. 113-120.
  9. M. P. Salisbury, S. E. Anderson, R. Barzel, and D. H. Salesin, "Interactive pen-and-ink illustration," in Proceedings of the 21st annual conference on Computer graphics and interactive techniques, 1994, pp. 101-108.
  10. M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin, "Orientable textures for image-based pen-and-ink illustration," in Proceedings of the 24th annual conference on Computer graphics and interactive techniques, 1997, pp. 401-406.
  11. M. C. Sousa and J. W. Buchanan, "Observational models of graphite pencil materials," in Computer Graphics Forum, vol. 19, no. 1, 2000, pp. 27-49. https://doi.org/10.1111/1467-8659.00386
  12. F. Durand, V. Ostromoukhov, M. Miller, F. Duranleau, and J. Dorsey, "Decoupling strokes and high-level attributes for interactive traditional drawing," in Rendering Techniques 2001, 2001, pp. 71-82.
  13. O. Deussen, S. Hiller, C. Van Overveld, and T. Strothotte, "Floating points: A method for computing stipple drawings," in Computer Graphics Forum, vol. 19, no. 3, 2000, pp. 41-50. https://doi.org/10.1111/1467-8659.00396
  14. A. Secord, "Weighted voronoi stippling," in Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, 2002, pp. 37-43.
  15. A. Hausner, "Simulating decorative mosaics," in Proceedings of the 28th annual conference on Computer graphics and interactive techniques, 2001, pp. 573-580.
  16. V. Ostromoukhov, "Digital facial engraving," in Proceedings of the 26th annual conference on Computer graphics and interactive techniques, 1999, pp. 417-424.
  17. A. W. Klein, P.-P. J. Sloan, A. Finkelstein, and M. F. Cohen, "Stylized video cubes," in Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, 2002, pp. 15-22.
  18. J. P. Collomosse and P. M. Hall, "Cubist style rendering from photographs," IEEE Transactions on Visualization and Computer Graphics, vol. 9, no. 4, pp. 443-453, 2003. https://doi.org/10.1109/TVCG.2003.1260739
  19. D. DeCarlo and A. Santella, "Stylization and abstraction of photographs," in ACM transactions on graphics (TOG), vol. 21, no. 3, 2002, pp. 769-776. https://doi.org/10.1145/566654.566650
  20. J. Canny, "A computational approach to edge detection," IEEE Transactions on pattern analysis and machine intelligence, no. 6, pp. 679-698, 1986.
  21. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Transactions on pattern analysis and machine intelligence, vol. 24, no. 5, pp. 603-619, 2002. https://doi.org/10.1109/34.1000236
  22. J. Wang, Y. Xu, H.-Y. Shum, and M. F. Cohen, "Video tooning," ACM Transactions on Graphics, vol. 23, no. 3, pp. 574-583, 2004. https://doi.org/10.1145/1015706.1015763
  23. F.Wen, Q. Luan, L. Liang, Y.-Q. Xu, and H.-Y. Shum, "Color sketch generation," in Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, 2006, pp. 47-54.
  24. H. Kang, S. Lee, and C. K. Chui, "Flow-based image abstraction," IEEE Transactions on Visualization and Computer Graphics, vol. 15, no. 1, pp. 62-76, 2009. https://doi.org/10.1109/TVCG.2008.81
  25. J. Fischer, D. Bartz, and W. Straber, "Stylized augmented reality for improved immersion," in Virtual Reality, 2005. Proceedings. VR 2005. IEEE, 2005, pp. 195-202.
  26. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Computer Vision, 1998. Sixth International Conference on, 1998, pp. 839-846.
  27. A. Orzan, A. Bousseau, P. Barla, and J. Thollot, "Structure-preserving manipulation of photographs," in Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, 2007, pp. 103-110.
  28. B. Gooch, E. Reinhard, and A. Gooch, "Human facial illustrations: Creation and psychophysical evaluation," ACM Transactions on Graphics (TOG), vol. 23, no. 1, pp. 27-44, 2004. https://doi.org/10.1145/966131.966133
  29. D. Marr and E. Hildreth, "Theory of edge detection," Proceedings of the Royal Society of London B: Biological Sciences, vol. 207, no. 1167, pp. 187-217, 1980. https://doi.org/10.1098/rspb.1980.0020
  30. H. Winnemoller, S. C. Olsen, and B. Gooch, "Real-time video abstraction," in ACM Transactions On Graphics, vol. 25, no. 3, 2006, pp. 1221-1226. https://doi.org/10.1145/1141911.1142018
  31. B. Seo and J. Kim, "Imtoon: Image-based cartoon authoring system using image processing," Journal of the Korea Computer Graphics Society, vol. 23, no. 2, pp. 11-22, 2017. https://doi.org/10.15701/kcgs.2017.23.2.11