Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient Non-photorealistic Rendering Technique in Single Images and Video

영상 동영상에서의 효율적인 비사실적 렌더링

  • 손태일 (중앙대학교 첨단영상대학원 영상학과) ;
  • 박경주 (중앙대학교 첨단영상대학원 영상학과)
  • Received : 2012.01.25
  • Accepted : 2012.06.18
  • Published : 2012.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to present a non-photorealistic rendering technique that is efficient in single images and moving images. In case of single images, they could be processed in a real-time base by realizing flow-based DoG filter and bilateral filter, which have been frequently used in the single image NPR technique recently, in the CUDA environment. In case of moving images, the investigator presented not the existing method of NPR moving images which generating images by applying the single image NPR technique to every frame, but the method of using the single image NPR technique in the first frame and stylizing it, and then of using the motion vector-based pixel mapping in the second frame on and copying the bright values of pixels that move on the frame into the location of next frame's motion vector, thus reducing unnecessary volume of calculation and maintaining the consistency between frames. In this study, the performance of this method was proved via an experiment.

본 연구에서는 단일영상과 동영상에서의 효율적인 비사실적 렌더링 기법을 제안한다. 단일영상의 경우에는 최근 단일영상 NPR 기법에서 많이 사용되는 플로우 기반 DoG 필터와 Bilateral 필터를 CUDA 환경에서 구현하여 실시간 처리가 가능하게 한다. 또한 동영상의 경우에는 기존의 NPR 동영상 방법인 매 프레임마다 단일영상 NPR 기법을 적용하여 생성하는 방법이 아닌 첫 프레임은 단일영상에 적용되는 NPR기법을 사용하여 스타일화 하고, 다음 프레임부터는 움직임 벡터를 기반으로 한 픽셀 맵핑을 사용하여 이전 프레임에서 움직임이 있는 픽셀의 밝기 값을 다음 프레임의 움직임 벡터 위치로 복사함으로써 불필요한 계산량을 줄이고, 프레임 간의 일관성 또한 유지시키는 방법을 제안한다. 본 연구에서는 실험을 통하여 그 성능을 증명하였다.

Keywords

References

  1. J. Canny, "A Computational Approach to Edge Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8, Issue 6, pp. 679-698, 1986. https://doi.org/10.1109/TPAMI.1986.4767851
  2. C. Tomasi and R. Manduchi, "Bilateral Filtering for Gray and Color Images," Proc. of the 1998 IEEE International Conference on Computer Vision. pp. 839-846, 1998.
  3. D. Decarlo and A. Santella, "Stylization and Abstraction of Photographs." ACM TOG (Proceedings of SIGGRAPH 2002) , pp. 769-776, 2002.
  4. A. Orzan, A. Bousseau, P. Barla, and J. Thollot, "Structure-preserving Manipulation of Photographs," Proc. Non-Photorealistic Animation and Rendering, pp. 103-110, 2007.
  5. H. Kang, S. Lee, and C. Chui, "Coherent Line Drawing," Proc. NPAR (2007) , pp. 43-50. 2007.
  6. H. Kang, S. Lee, and C. Chui, "Flow-Based Image Abstraction," IEEE Transactions on Visualization and Computer Graphics, Vol. 15, Issue 1, pp. 62-76, 2009. https://doi.org/10.1109/TVCG.2008.81
  7. H. Kang, and S. Lee, "Shape-Simplifying Image Abstraction," Computer Graphics Forum, Vol. 27, Issue 7, pp. 1773-1780, 2008. https://doi.org/10.1111/j.1467-8659.2008.01322.x
  8. J. E. Kyprianidis, and J. Dollner, "Image Abstraction by Structure Adaptive Filtering," Proc. EG UK Theory and Practice of Computer Graphics, Eurographics Association, pp. 51-58. 2008.
  9. H. Kang, C. Chui, and U. Chakraborty, "A Unified Scheme for Adaptive Stroke-based Rendering," The Visual Computer, Vol. 2, No. 9, pp. 814-824, 2006.
  10. H. Winnemöller, S. C. Olsen, and B. Gooch, "Real-Time Video Abstraction," SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, pp. 1221-1226, 2006.
  11. B. Gooch, E. Reinhard, and A. Gooch, "Human Facial Illustrations: Creation and Psychophysical evaluation," ACM Trans. Graph., Vol. 23, Issue 1, pp. 27-44, 2004. https://doi.org/10.1145/966131.966133
  12. M. Son, H. Kang, and Y. Lee, "Abstract Line Drawings from 2D Images," Proc. of the IEEE Pacific Conference on Computer Graphics and Applications (PG'07) , pp. 333-342. 2007.
  13. P. Litwinowicz, "Processing Images and Video for an Impressionist Effect," SIGGRAPH' 97, pp. 407-414, 1997.
  14. A. Hertzmann, and K. Perlin "Painterly Rendering for Video and Interaction," NPAR'2000, pp. 7-12, 2000.
  15. A. Hertzmann, "Fast Paint Texture," NPAR' 2000, pp. 91-96, 2002.
  16. J. Hays, and I. Essa, "Image and Video Based Painterly Animation," NPAR'2004, pp. 113-120, 2004.
  17. A. Bousseau, F. Neyret, J. Thollot, and D. Salesin, "Video Watercolorization using Bidirectional Texture Advection," ACM Transactions on Graphics, Vol. 26, No. 3, pp 104, 2007. https://doi.org/10.1145/1276377.1276507
  18. 계희원, 김준호, "GPGPU 환경에서 최대휘소투영 렌더링의 고속화 방법," 멀티미디어학회논문지, 제14권, 제8호, pp.981-991, 2011. https://doi.org/10.9717/kmms.2011.14.8.981
  19. Jianhua Lu and Ming L. Liou, "A Simple and Efficent Search Algorithm for Block-Matching Motion Estimation," IEEE Trans. Circuits And Systems For Video Technology, Vol. 7, No. 2, pp. 429-433, 1997. https://doi.org/10.1109/76.564122
  20. 박성모, 유태경, 정용재, 문광석, 김종남, "움직임 벡터의 분포와 적응적인 탐색 패턴 및 매칭기준을 이용한 유사 무손실 고속 움직임 예측 알고리즘," 멀티미디어학회논문지, 제13권, 제7호, pp. 991-999, 2010.
  21. Shan Zhu and Kai-Kuang Ma, "A New Diamond Search Algorithm for Fast Block- Matching Motion Estimation," IEEE Transactions on Image Processing, Vol. 9, No. 2, PP. 292-296, 2000.