DOI QR코드

DOI QR Code

3DTIP: 3D Stereoscopic Tour-Into-Picture of Korean Traditional Paintings

3DTIP: 한국 고전화의 3차원 입체 Tour-Into-Picture

  • Jo, Cheol-Yong (Computer and Communications Eng., Kangwon National University) ;
  • Kim, Man-Bae (Computer and Communications Eng., Kangwon National University)
  • 조철용 (강원대학교 컴퓨터정보통신공학과) ;
  • 김만배 (강원대학교 컴퓨터정보통신공학과)
  • Published : 2009.09.30

Abstract

This paper presents a 3D stereoscopic TIP (Tour Into Picture) for Korean classical paintings being composed of persons, boat, and landscape. Unlike conventional TIP methods providing 2D image or video, our proposed TIP can provide users with 3D stereoscopic contents. Navigating a picture with stereoscopic viewing can deliver more realistic and immersive perception. The method firstly makes input data being composed of foreground mask, background image, and depth map. The second step is to navigate the picture and to obtain rendered images by orthographic or perspective projection. Then, two depth enhancement schemes such as depth template and Laws depth are utilized in order to reduce a cardboard effect and thus to enhance 3D perceived depth of the foreground objects. In experiments, the proposed method was tested on 'Danopungjun' and 'Muyigido' that are famous paintings made in Chosun Dynasty. The stereoscopic animation was proved to deliver new 3D perception compared with 2D video.

본 논문에서는 인물, 배, 풍경 등으로 구성되는 한국 고전화의 3D 입체 Tour-Into-Picture를 제안한다. 기존의 TIP 기법은 2D 영상 또는 동영상을 제공하는 것과는 달리, 제안하는 TIP는 3차원 입체 콘텐츠를 제공한다. 따라서 한 장의 영상 내부를 항해하면서 입체로 시청할 수 있는 특징이 있다. 제안 방법은 첫째 전경 마스크, 배경영상, 및 깊이맵을 생성한다. 다음에는 영상 내부를 항해하면서 투영 영상들을 획득한다. 마지막으로 전경객체에서 발생하는 카드보드효과를 감소시키기 위하여 템플릿 및 로스 텍스처 필터 기반 깊이맵 생성을 새로이 제안한다. 제안 방법을 조선시대의 작품인 신윤복의 '단오풍정'과 김홍도의 '무이귀도'에 적용하였고, 입체 애니메이션으로 제작되어 보다 실감 있는 콘텐츠를 제공한다.

References

  1. Y. Horry, K. Anjyo, and K. Arai, 'Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image,' Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 225-232, 1997 https://doi.org/10.1145/258734.258854
  2. K. Boulanger, K. Bouatouch, S. Pattanaik, 'ATIP: A Tool for 3D Navigation inside a Single Image with Automatic Camera Calibration,' EG UK Theory and Practice of Computer Graphics 2006
  3. N. S. Chu and C. Tai, 'Animating Chinese landscape paintings and panorama using multi-perspective modeling,' Proceedings of International Conference on Computer Graphics, IEEE. pp. 107-113, 2001 https://doi.org/10.1109/CGI.2001.934664
  4. K. Anjyo, 'Tour into the picture as a non-photorealistic animation,' Computer Graphics, pp 54-55, 1999 https://doi.org/10.1145/563666.563686
  5. 황태규, 윤경현, '새로운 모델링방법에 의한 개선된 TIP,' 한국 컴퓨터 그래픽스학회 학술대회 논문지, pp. 95-100, 1999
  6. H. W. Kang and S. Y. Shin, 'Tour into the video: image-based navigation scheme for video sequences of dynamic scenes,' ACM Symposium on Virtual Reality and Software Technology, Nov. 11-13. pp. 73-80, 2002 https://doi.org/10.1145/585740.585753
  7. H. Yamanoue, M. Okui and F, Okano, "Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV Images," IEEE Trans. On Circuits and Systems for Video Technology, Vol. 16, No. 6, June 2006 https://doi.org/10.1109/TCSVT.2006.875213
  8. H. Yamanoue, M. Okui and I. Yuyama. 'A study on the relationship between shooting conditions and cardboard cffcct of stereoscopic Images,' IEEE Trans. On Circuits and Systems for Video Technology, Vol. 10, No. 3, Apr. 2000 https://doi.org/10.1109/76.836285
  9. A. Criminisi, P. Perez and K. Toyama, 'Region filling and object removal by exemplar-based image inpainting,' IEEE Trans. Image Processing, Vol. 13, No. 9, pp. 1200-1212, 2004 https://doi.org/10.1109/TIP.2004.833105
  10. R. Seidel, 'A simple and fast randomized algorithm for computing trapezoidal decompositions and for triangulating polygons,' ComputationaI Geometry Theory & Application, Vol. 1, pp. 51-64, 1991 https://doi.org/10.1016/0925-7721(91)90012-4
  11. E. R. Davies, Laws' texture energy in Texture. In Machine Vision: Theory, Algorithms, Practicalities, 2nd Ed., Academic Press, San Diego, 1997
  12. J. Michels, A. Saxena, and A. Y. Ng, 'High speed obstacle avoidance using monocular vision and reinforcement learning,' Proc. of International Conference on Machine Learning, ACM, 2005 https://doi.org/10.1145/1102351.1102426
  13. D. F. McAllister (editor), Stereo computer graphics and other true 3D technologies, Princeton, NJ:Princeton University Press, 1993