Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

Study on Compositing Editing of 360˚ VR Actual Video and 3D Computer Graphic Video

360˚ VR 실사 영상과 3D Computer Graphic 영상 합성 편집에 관한 연구

  • Lee, Lang-Goo (Dept. of Multimedia, Graduate School of Digital Image and Contents, Dongguk University) ;
  • Chung, Jean-Hun (Dept. of Multimedia, Graduate School of Digital Image and Contents, Dongguk University)
  • 이랑구 (동국대학교 영상대학원 멀티미디어학과) ;
  • 정진헌 (동국대학교 영상대학원 멀티미디어학과)
  • Received : 2018.10.28
  • Accepted : 2019.04.20
  • Published : 2019.04.28
Download PDF
⟨ Previous Next ⟩

Abstract

This study is about an efficient synthesis of $360^{\circ}$ video and 3D graphics. First, the video image filmed by a binocular integral type $360^{\circ}$ camera was stitched, and location values of the camera and objects were extracted. And the data of extracted location values were moved to the 3D program to create 3D objects, and the methods for natural compositing was researched. As a result, as the method for natural compositing of $360^{\circ}$ video image and 3D graphics, rendering factors and rendering method were derived. First, as for rendering factors, there were 3D objects' location and quality of material, lighting and shadow. Second, as for rendering method, actual video based rendering method's necessity was found. Providing the method for natural compositing of $360^{\circ}$ video image and 3D graphics through this study process and results is expected to be helpful for research and production of $360^{\circ}$ video image and VR video contents.

연구는 $360^{\circ}$ 동영상과 3D 그래픽의 효율적인 합성 방법에 관한 연구이다. 먼저, 이안식 일체형 $360^{\circ}$ 카메라로 촬영한 영상을 스티칭하고, 영상에서 카메라 및 사물의 위치값을 추출하였다. 그리고 추출한 위치값의 데이터를 3D 프로그램으로 불러와 3D 오브젝트를 생성하고, 자연스러운 합성을 위한 방법에 관하여 연구하였다. 그 결과 $360^{\circ}$ 동영상과 3D 그래픽의 자연스러운 합성을 위한 방법으로 렌더링 요소와 렌더링 기법을 도출할 수 있었다. 첫째, 렌더링 요소로는 3D 오브젝트의 위치와 재질, 조명과 그림자가 있었고, 둘째, 렌더링 기법으로는 실사 기반 렌더링 기법의 필요성을 찾을 수 있었다. 본 연구 과정 및 결과를 통해 $360^{\circ}$ 동영상과 3D 그래픽의 자연스러운 합성에 관한 방법을 제시함으로써, $360^{\circ}$ 동영상 및 VR 영상 콘텐츠의 연구와 제작 분야에 도움이 될 것으로 기대한다.

Keywords

DJTJBT_2019_v17n4_255_f0001.png 이미지

Fig. 1. 3D Computer Graphics2)

DJTJBT_2019_v17n4_255_f0002.png 이미지

Fig. 3. 3D Camera Tracking Screen in After Effects CC

DJTJBT_2019_v17n4_255_f0004.png 이미지

Fig. 4. 3D Object Position Setting and Material Application Screen

DJTJBT_2019_v17n4_255_f0005.png 이미지

Fig. 5. Lighting and Shadow Setup Screen

DJTJBT_2019_v17n4_255_f0006.png 이미지

Fig. 6. Standard Renderer Rendering Image

DJTJBT_2019_v17n4_255_f0007.png 이미지

Fig. 7. Octane Renderer Rendering Image

DJTJBT_2019_v17n4_255_f0008.png 이미지

Fig. 8. Final Image Result

DJTJBT_2019_v17n4_255_f0009.png 이미지

Fig. 2. Ricoh Theta S Camera, Original Images and Stitched Panoramic Images

References

  1. Naver(Online). https://blog.naver.com/thetenant/221292136944
  2. K. S. Kim & Y. H. Lee. (2016). Comparison and Usage Analysis of 360 Degree VR Video Rigs, The Society of Modern photograpty & Video, 19(1), 90.
  3. B. G. Kang & S. H. Ryu & W. B. Lee (2017). Development of an Interactive Virtual Reality Service based on 360 degree VR Image, Journal of Digital Convergence, 15(11), 464.
  4. J. H. Lee & J. H. Moon. (2018). The impact of the natural mapping level of a 360-degree video on the user's presence, attitude, enjoyment, and persistence, Korea OHH Advertising Society Spring Regular Conference, 27.
  5. wikipedia(Online). https://ko.wikipedia.org/wiki/3%EC%B0%A8%EC%9B%90_%EC%BB%B4%ED%93%A8%ED%84%B0_%EA%B7%B8%EB%9E%98%ED%94%BD%EC%8A%A4
  6. wikipedia(Online). https://ko.wikipedia.org/wiki/%EB%A0%8C%EB%8D%94%EB%A7%81
  7. J. K. Kim & T. G. Lee. (2012). The Study on the Management of Efficient Rendering Process Manage in 3D Stereoscopic Animation Production, Journal of Integrated Design Research, 11(4), 108.
  8. J. S. Kim & H. S. Kwak. (2007). Expression of Cartoon Rendering Method in Image Contents, Journal of the korea contents association, 7(8), 142. https://doi.org/10.5392/JKCA.2007.7.8.142
  9. K. R. Lee et al. (2016). Non-photorealistic Rendering Using a VR-Device Augmented Reality System, Proceedings of the Korean Information Science Society, 89.
  10. H. W. Jang & I. H. Lee. (2005). The Recent Trends of Rendering Technologies for Realistic Scene Representation, Electronics and telecommunications trends, 20(6), 98.
  11. L. G. Lee & J. H. Chung. (2018). A Study on Effective Stitching Technique of $360^{\circ}$ Camera Image, Journal of Digital Convergence, 16(2), 336.
  12. yonhapnews(Online). http://www.yonhapnews.co.kr/bulletin/2017/04/10/0200000000AKR20170410161100017.HTML
  13. G. H. Hwang & S. H. Park. (2012). Feature-Based Light and Shadow Estimation for Video Compositing and Editing, Journal of the Korea Computer Graphics Society, 18(1), 3.
  14. J. N. Sohn & T. W. Han. (2015). Texture mapping of 3D game graphics - characteristics of hand painted texture, Journal of Digital Convergence, 13(11), 332.
  15. Maxon(Online). https://www.maxon.net/de/produkte/workflow-integration/render-engines/
  16. wikipedia(Online). https://ko.wikipedia.org/wiki/%EB%AC%BC%EB%A6%AC_%EA%B8%B0%EB%B0%98_%EB%A0%8C%EB%8D%94%EB%A7%81