International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Virtual Studio Application using Microsoft Hololens

  • Lee, Jaehyun (Graduate School of Information and Contents, Kwangwoon University) ;
  • Kim, Seunghyeon (Graduate School of Information and Contents, Kwangwoon University) ;
  • Kim, Lyounghui (Department of Plasma Bio Display, Kwangwoon University) ;
  • Kang, Jinwook (Geminisoft Co., Ltd.) ;
  • Lee, Seunghyun (Department of Plasma Bio Display, Kwangwoon University) ;
  • Kwon, Soonchul (Department of Plasma Bio Display, Kwangwoon University)
  • Received : 2017.11.15
  • Accepted : 2017.12.10
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Mixed Reality (MR) shows a composite image of a virtual object in the real world. It has been applied to various fields by the introduction of head mounted display (HMD) such as Microsoft's Hololens [1-3]. The virtual studio in broadcasting combines the contents created by computer graphics with the actual set to reproduce the 3D image screen. This requires physical space such as a set of chroma keys. It also requires professional knowledge and manpower and costly equipment to post-process the graphics and information for long periods of time. Therefore, in this paper, we aim to study the implementation of virtual studio based on Mixed Reality using Microsoft Hololens. Through the implementation of 'Holo-studio' application, realistic and virtual objects of broadcasting camera viewpoint were acquired at the same time. Using Microsoft's spectator view library, the frame rate is degraded in objects with high polygons (100,000 polygons). The proposed method maintains 60 fps image transmission in high polygon objects. The results of this paper show the possibility of using virtual studio at low cost which does not need separate physical space.

Keywords

References

  1. Mixed Reality, https://en.wikipedia.org/wiki/Mixed_reality.
  2. Tepper, Oren M., Rudy, Hayeem L., Lefkowitz, Aaron,Weimer, Katie A, Marks, Shelby M, Stern, Carrie S., Garfein, and Evan S., " Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room," Journal of the American society of plastic Surgeons, Vol. 140, No. 5, pp. 1066-1070, 2017.
  3. Ryan P. Spicer, Stephen M. Russell, and Evan Suma Rosenberg, "The mixed reality of things: emerging challenges for human-information interaction," Stereoscopic Displays and Virtual Reality Systems X(SPIE), Vol. 10207, 2017.
  4. Branimir Jaksic, Boris Gara, Mile Petrovic, Petar Spalevic, and Ljubomir Lazic, "Analysis of the Impact of Front and Back light on Image Compression with SPIHT Method during Realization of Chorma Key Effect in Virtual TV Studio," Journal of Applied Science Acta Polytechica Hungaica, Vol. 12, No. 2, pp. 71-88, 2015.
  5. Ronen Gvili, Amir Kaplan, Eyal Ofek and Giora Yahav, "Depth keying," Stereoscopic Displays and Virtual Reality Systems X(SPIE), Vol. 5006, pp. 554-563, 2003.
  6. Darryl Charles, Katy Pedlow, Suzanne McDonough, Ka Shek, and Therese Charles, "Close range depth sensing cameras for virtual reality based hand rehabilitation," Journal of Assistive Technologies, Vol. 8, No. 3, pp. 138-149, 2014. https://doi.org/10.1108/JAT-02-2014-0007
  7. Kellner Falko, Schiller Ingo, Bartczak Bogumil, and Koch Reinhard, "Increasing Realism and Supporting Content Planning for Dynamic Scenes in a Mixed Reality System incorporating a Time-of-Flight Camera," Journal of Virtual Reality and Broadcasting, Vol. 7, No. 4, 2010.
  8. Andreas Pomi and Philipp Slusallek, "Interactive Ray Tracing for Virtual TV Studio Applications," Journal of Virtual Reality and Broadcasting, Vol. 2, No. 2, 2005.
  9. M. Ben-Ezra, "Segmentation with invisible keying signal", Proc. Of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 32-37, 2000.
  10. S. Karthika, P. Praveena, and M.GokilaMani "Hololens," International Journal of Computer Science and Mobile Computing (IJSCMC), Vol. 6, No. 2, pp. 41-50, 2017.
  11. Yadav Ashok kumar Chintamani, "Research Issues in Hololens," International Journal of Advanced Research in Computer Engineering & Technology (IJARCET), Vol. 5, No. 5, pp. 1657-1663, 2016.
  12. Leehwan Hwang, Jaehyun Lee, Jahanzeb Hafeez, Jinwook Kang, Seunghyun Lee, and Soonchul Kwon, "A Study on Optimized Mapping Environment for Real-time Spatial Mapping of HoloLens," International Journal of Internet, Broadcasting and Communication, Vol. 9, No. 3, pp. 1-8, 2017.
  13. Reid Vassallo; Adam Rankin; Elvis C. S. Chen; Terry M. Peters, "Hologram stability evaluation for Microsoft HoloLens," Stereoscopic Displays and Virtual Reality Systems X(SPIE), Vol. 10136, 2017.
  14. Microsoft Hololens Library. https://developer.microsoft.com/en-us/windows/mixed-reality.