International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Shamanistic Expression Method of Performances Using VR Technology: Body Ownership and Gaze

  • Kim, Tae-Eun (Dept. of Performance Theater Media, Dong Yang University)
  • Received : 2018.05.22
  • Accepted : 2018.06.11
  • Published : 2018.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Virtual reality (VR) technology has been increasingly more frequently used day by day in industries, entertainment and performances due to the development of AR and MR technologies. Performance arts also actively utilize $360^{\circ}$ VR technology due to the free expression of stage settings and auditoriums. However, technologies for systems in which performers wear VR devices firsthand rather than being in the sandpoint of bystanders while audiences wear VR head mounted displays(HMDs) to see performance stages have been rarely studied yet. This study investigated the technical possibilities of possible methods of expression that will enable performers to appear on the stage wearing VR devices. Since VR can maximize the sense of immersion with its closed HMD structure unlike augmented reality (AR), VR was judged to be suitable for studies centered on the mental interactions in the inner side of humans. Among them, to implement shamanistic expression methods with the phantoms of the body and soul, a motion capture technology linked with VR display devices and real-time cameras was realized on the stage. In this process, the importance of body ownership experienced by the performers (participants), reactions when they lost it, and the mental phenomena of the desire to possess the subjects of gaze could be seen. In addition, high possibility of development of this technology hereafter could be expected because this technology includes the technical openness that enables the audience to appear on the stage firsthand to become performers.

Keywords

References

  1. J. McKenzie, Virtual reality: Performance, immersion, and the thaw. TDR (1988-), 38(4), pp. 83-106, 1994. https://doi.org/10.2307/1146426
  2. E.H Park, and Y.K. Kim, "Virtual Reality Technology Application in Performance and the Determinants of Audience's Immersion," Jourmal of the HCI Society of Korea, , pp. 1041-1043. Jan 2012.
  3. Tae, H. S., & Park, M. S. "Convergent Approaches to Dance as a Discipline." The Journal of the Korea Contents Association, Vol. 12(12), pp.605-615. 2012 DOI: https://doi.org/10.5392/JKCA.2012.12.12.605
  4. Y. Moon., S.H. Jin ,"A study on convergence of Art-Tech contents applying Virtual Reality" The Korean Journal of Dance, Vol. 74(6), pp. 176-196. 2016.
  5. De Vignemont, F., Mind the body: An exploration of bodily self-awareness. Oxford University Press., pp. 52-57, 2018
  6. M. Slater and W. Sylvia, "A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments", Teleoperators and virtual environments, Vol. 6(6), pp. 603-616, 1997. https://doi.org/10.1162/pres.1997.6.6.603
  7. T. Iorns and T. Rhee, "Real-Time Image Based Lighting for 360-Degree Panoramic Video", Pacific-Rim Symposium on Image and Video Technology, pp. 139-151, 2015.
  8. T. Rhee, L. Petikam, B. Allen and A. Chalmers, "MR360: Mixed Reality Rendering for 360-Panoramic Videos", IEEE Transactions on Visualization and Computer Graphics, Vol. 23(4), pp. 1379-1388, 2017. https://doi.org/10.1109/TVCG.2017.2657178
  9. F. Perazzi, A. Sorkine-Hornung, H. Zimmer, P. Kaufmann, O. Wang, S. Watson and M. Gross, "Panoramic Video from Unstructured Camera Arrays", Computer Graphics Forum. Vol. 34(2), pp. 57-68, 2015. https://doi.org/10.1111/cgf.12541
  10. J. Lee, B. Kim, K, Kim, Y. Kim and J. Noh, "Rich360: optimized spherical representation from structured panoramic camera arrays", ACM Transactions on Graphics(TOG), Vol. 35(4), pp. 63, 2016.
  11. M. J. Lim, H. W. Jung, K. Y. Lee, "Game-type Recognition Rehabilitation System based on Augmented Reality through Object Understanding", The Journal of The Institute of Webcasting, Internet and Telecommunication VOL. 11 No. 3, Mar 2013.
  12. M. Slater and W. Sylvia, "A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments", Teleoperators and virtual environments, Vol. 6(6), pp. 603-616, 1997. https://doi.org/10.1162/pres.1997.6.6.603
  13. Chen, W. Y., Huang, H. C., Lee, Y. T., & Liang, C., "Body ownership and the four-hand illusion." Scientific reports, Vol. 8(1), pp. 2153, Feb 2018 https://doi.org/10.1038/s41598-018-19662-x
  14. B.H. Lee, J.Y. Choi, B.H. Choi, J.S. Lee, B.G. Min, J.H. Cho, "A Study on HMD-AR based Industrial Training System for Live Machinery Operation", International Journal of Internet, Broadcasting and Communication Vol.10 No.1 65-70 (2018) DOI: http://dx.doi.org/10.7236/IJIBC.2018.10.1.9
  15. Slattery, D. R., "VR and hallucination: a technoetic perspective.", Technoetic Arts, Vol. 6(1), pp. 3-18, 2008. https://doi.org/10.1386/tear.6.1.3_1
  16. Peck, T. C., Bourne, K. A., & Good, J. J., "The Effect of Gender Body-Swap Illusions on Working Memory and Stereotype Threat." IEEE transactions on visualization and computer graphics, Vol. 24(4), pp.1604-1612, 2018. https://doi.org/10.1109/TVCG.2018.2793598
  17. B. Frank. "The cyborg's dilemma: Progressive embodiment in virtual environments." Human Factors in Information Technology Vol.13, pp.113-144, 1999.
  18. Ascott, R. (1999). Seeing double: Art and the technology of transcendence. Reframing Consciousness: Art, Mind and Technology, edited by Roy Ascott, 66-71.
  19. O'Hagan, R, G, Zelinsky, A. and Rougeatux, S. "Visual Gesture Interfaces for virtual environment." , Interaction with computers. Vol.14. no3. pp. 231-250. 2002 https://doi.org/10.1016/S0953-5438(01)00050-9