Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Interactive VFX System for TV Virtual Studio

TV 가상 스튜디오용 인터랙티브 VFX 시스템

  • Byun, Hae Won (School of Information Technology, Sungshin Women's University)
  • Received : 2015.11.10
  • Accepted : 2015.11.27
  • Published : 2015.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we presents visual effect(water, fire, smoke) simulation and interaction system for TV virtual studio. TV virtual studio seamlessly synthesizes CG background and a live performer standing on a TV green studio. Previous virtual studios focus on the registration of CG background and a performer in real world. In contrast to the previous systems, we can afford to make new types of TV scenes more easily by simulating interactive visual effects according to a performer. This requires the extraction of the performer motion to be transformed 3D vector field and simulate fluids by applying the vector field to Navier Stokes equation. To add realism to water VFX simulation and interaction, we also simulate the dynamic behavior of splashing fluids on the water surface. To provide real-time recording of TV programs, real-time VFX simulation and interaction is presented through a GPU programming. Experimental results show this system can be used practically for realizing water, fire, smoke VFX simulation and the dynamic behavior simulation of fish flocks inside ocean.

본 논문에서는 방송국 그린 스튜디오에 서 있는 연기자와 CG로 표현되는 스페셜 이펙트(물, 불, 연기 등)와의 상호작용을 제공하는 시스템을 제안한다. 기존의 가상 스튜디오는 주로 CG 배경과 연기자 촬영 영상을 정합하는 방법에 초점을 맞추고 있다. 기존의 연구와 달리 본 논문에서는 실제 연기자와 상호작용하는 비주얼 이펙트를 시뮬레이션하는데 집중함으로써 TV 화면에서 새로운 영역을 표현하고자 한다. 연기자 동작에 비주얼 이펙트를 연동하기 위하여 깊이 카메라를 이용하여 연기자 동작을 추출한다. 이를 3차원 벡터 필드로 변환하고 Navier Stokes 방정식의 외력으로 적용하여 물, 불, 연기의 유체를 시뮬레이션한다. 특히, 물의 상호작용을 사실적으로 표현하기 위하여 물에 연동되는 스플레쉬의 상호작용도 함께 시뮬레이션하여 물이 등장하는 비주얼 이펙트의 사실감을 극대화시켰다. TV의 실시간 녹화를 지원하기 위하여 GPU 프로그래밍을 도입하여 VFX의 실시간 상호작용을 지원하는 기능도 추가하였다. 제안된 방법의 유용성은 물, 불, 연기, 바다 속 물고기 떼 등의 VFX 시뮬레이션과 연기자와의 상호작용 실험을 통하여 확인할 수 있었다.

Keywords

Acknowledgement

Supported by : 성신여자대학교

References

  1. L. Blonde, M. Buck, R. Galli, W. Niem, Y. Paker, W. Schmidt, and G. Thomas, "A Virtual Studio for Live Broadcasting: The Mona Lisa Project", IEEE Multimedia, Vol.3, No.2, pp. 18-29, 1996. https://doi.org/10.1109/93.502291
  2. Seongwoo Park, Yongduek Seo, and Kisang Hong, "Real-Time Camera Calibration for Virtual Studio", Real Time Imaging, Vol.6, Issue 6, pp. 433-448, 2000. https://doi.org/10.1006/rtim.1999.0199
  3. Woontack Woo, G.J. Kim, Chanmo Park, "3D Virtual Studio for Natural Interacting", IEEE Transactions on Systems, Man and Cybernetics, Vol.36, Issue 4, pp. 758-773, 2006. https://doi.org/10.1109/TSMCA.2005.855752
  4. Yunhao Li, Maojun Zhang, Bing Yang, and Lingda Wu, "Camera Tracking in Virtual Studio", Proc. SPIE 4553, Visualization and Optimization Techniques, 2001.
  5. H. W. Byun, "Interactive Visual Effect Simulation for TV Virtual Studio", International Journal of Applied Engineering Research, Vol.10, No.21, pp. 41780-41785, 2015
  6. VizRT, http://www.vizrt.com
  7. Brainstorm, http://www.brainstorm.es/
  8. M. Ihmsen, J. Orthmann, B. Solenthaler, A. Kolb, and M. Teschner, "SPH fluids in computer graphics," Eurographics, 2014.
  9. T. Amada, M. Imura, Y. Yasumuro, Y. Manabe, and K. Chihara, "Particle-based fluid simulation on GPU," SIGGRAPH, 2004.
  10. K. Hegeman, N. A. Carr, and G. Miller, "Particle-based fluid simulation on the GPU," Computational Science-ICCS, vol.3994 of Lecture Notes in Computer Science, pp. 228-235, 2006.
  11. Y. Zhang, B. Solenthaler, and R. Pajarola, "Adaptive sampling and rendering of fluids on the GPU," Proceedings of IEEE/EG Symposium on Volume and Point-Based Graphics, pp. 137-146, 2008.
  12. N. Bell, YU Y., and P.J. Mucha, "Particle-based simulation of granular materials". ACM SIGGRAPH/ Eurographics Symposium on Computer Animation, pp. 77-86, 2005.
  13. "Particle-based realistic simulation of fluid-solid interaction". Computer Animation and Virtual Worlds, Vol.21, No.6, pp. 89-595. 2010.
  14. M. Muller, S. Schirm, M. Teschner, B. Heidelberger, and M. Gross, "Interaction of fluids with deformable solids". Computer Animation and Virtual Worlds, Vol.15, No.3-4, pp. 159-171. 2004. https://doi.org/10.1002/cav.18
  15. M. Becker, H. Tessendorf, and M. Teschner, Direct forcing for lagrangian rigid-fluid coupling. IEEE Transactions on Visualization and Computer Graphics, Vol.15, No.3, pp. 493-503, 2009. https://doi.org/10.1109/TVCG.2008.107
  16. R. Weller and G. Zachmann, "Inner sphere trees and their application to collision detection". Virtual Realities. pp. 181 -202, 2011.
  17. R. Weller and G. Zachmann, "Inner Sphere Trees". Tech. Report, pp. 08-09, 2008.
  18. R. Weller and G. Zachmann, "Inner sphere trees for proximity and penetration queries." Robotics: Science and Systems Conference, 2009.
  19. R. Weller and G. Zachmann, "Stable 6-DOF haptic rendering with inner sphere trees." International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, 2009.
  20. R. P. Fedkiw, "Coupling an eulerian fluid calculation to a lagrangian solid calculation with the ghost fluid method", Journal of Computational Physics, Vol.175, No.1, pp. 200-224. 2002. https://doi.org/10.1006/jcph.2001.6935
  21. Jos Stam, "Stable Fluids", SIGGRAPH 99 Conference Proceedings, pp. 121-128, 1999.
  22. Andrew Selle, Nick Rasmussen, and Ronald Fedkiw, "A vortex particle method for smoke, water and explosions" ACM Transactions on Graphics (TOG), Vol.24, Issue 3, pp. 910-914, 2005.