Journal of Platform Technology

ICT Platform Society (ICT플랫폼학회)
권호 표지

A Study on Intelligent VR/AR Education Platform for Realistic Content Production

  • Hyun-Sook Lee (Kangnam, University, Dept. of AI.SW Convergence Research Institute) ;
  • Jee-Uk Heu (Kangnam University, Dept. of KNU Cham-Injae College)
  • Received : 2023.12.07
  • Accepted : 2024.01.11
  • Published : 2024.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In recent years, a platform providing a Visual Programming development environment capable of 3D editing and interaction editing in an In-VR environment to quickly prototype VR/AR contents for education of VR and AR for general users and children. In the past, VR contents were mostly viewed by users. However, thanks to the rapid development of recent computing technologies, VR contents interacting with users have emerged as a device capable of tracking user behavior in a small size It was able to appear. In addition, because VR is extended to AR and MR, it can be used in all three virtual environments and requires efficient user interface(UI). In this paper, we propose UI based on eye tracking. Eye-tracking-based UI not only reduces the amount of time the user directly manipulates the controller, but also dramatically lowers the time spent on simple operations, while reducing the need for a dedicated controller by allowing multiple types of controllers to be used in combination. The proposed platform can easily create a prototype of their intended VR/AR App(or content) even for users(beginners) who do not have a certain level of knowledge and experience in 3D graphics and software coding, and share it with others. Therefore, this paper proposes a method to use VAL more effectively in a 5G environment.

Keywords

References

  1. Wayne E. Carlson, "Section 17.1. Virtual Reality," in A Critical History of Computer Graphics and Computer Animation: A Retrospective Overview, https://ohiostate.pressbooks.pub/graphicshistory/, Published by the Ohio State University, June 20, 2017.
  2. Chengyu Sun, Wei Hu, Diqiong Xu, "Navigation modes, operation methods, observation scales and background options in UI design for high learning performance in VR-based architectural applications," Journal of Computational Design and Engineering., Vol. 6, No. 2, pp. 189-196, April 2019. https://doi.org/10.1016/j.jcde.2018.05.006
  3. Hao Song, Qingjin Peng, Jian Zhang, Peihua Gu, "A VR-based Interactive System to Improve Users' Involvement in OAP Development," Procedia CIRP., Vol. 56, pp. 13-18, 2016. https://doi.org/10.1016/j.procir.2016.10.008
  4. R. Pages, K. Amplianitis, D. Monaghan, J. Ondrej, A. Smolic, "Affordable content creation for freeviewpoint video and VR/AR applications," Journal of Visual Communication and Image Representation., Vol. 53, pp. 192-201, 2018. https://doi.org/10.1016/j.jvcir.2018.03.012
  5. Philipp A. Rauschnabel, Reto Felix, Chris Hinsch, "Augmented reality marketing: How mobile ARapps can improve brands through inspiration," Journal of Retailing and Consumer Services., Vol. 49, pp. 43-53, 2019. https://doi.org/10.1016/j.jretconser.2019.03.004
  6. Abdullah, Dakhaz Mustafa, and Siddeeq Y. Ameen, "Enhanced mobile broadband (EMBB): A review," Journal of Information Technology and Informatics., Vol. 1, No 1, pp. 13-19, 2021.
  7. H. Ji, S. Park, J. Yeo, Y. Kim, J. Lee, and B. Shim, "Introduction to Ultra Reliable and Low Latency Communications in 5G," arXiv preprint arXiv:1704.05565, 2017.
  8. Bockelmann, Carsten, et al., "Massive machine-type communications in 5G: Physical and MAClayer solutions," IEEE communications magazine Vol. 54, Issue 9, pp. 59-65, 2016. https://doi.org/10.1109/MCOM.2016.7565189
  9. Hewitt D. Crane and Carroll M. Steele, "Generation-V dual-Purkinje-image eyetracker," Applied Optics. Vol. 24, Issue 4, pp. 527-537, 1985. https://doi.org/10.1364/AO.24.000527
  10. Md Fasiul Alam, Serafeim Katsikas, Olga Beltramello, Stathes Hadjiefthymiades, "Augmented and virtual reality based monitoring and safety system: A prototype IoT platform," Journal of Network and Computer Applications, Vol. 89, 1, pp. 109-119, 2017. https://doi.org/10.1016/j.jnca.2017.03.022
  11. Zhao, Jianzhou, et al., "Formalizing the LLVM intermediate representation for verified program transformations," in Proc. of the 39th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages, 2012, pp. 427-440.
  12. Georgios Mylonas, Christos Triantafyllis, Dimitrios Amaxilatis, "An Augmented Reality Prototype for supporting IoT-based Educational Activities for Energy-efficient School Buildings," Electronic Notes in Theoretical Computer Science, Vol. 343, pp. 89-101, 2019. https://doi.org/10.1016/j.entcs.2019.04.012
  13. Scott G. Dacko, "Enabling smart retail settings via mobile augmented reality shopping apps," Technological Forecasting and Social Change, Vol. 124, pp. 243-256, 2017. https://doi.org/10.1016/j.techfore.2016.09.032
  14. L. Gallo, A. Minutolo, G. De Pietro, "A user interface for VR-ready 3D medical imaging by off-theshelf input devices," Computers in Biology and Medicine, Vol. 40, Issue 3, pp. 350-358, 2010. https://doi.org/10.1016/j.compbiomed.2010.01.006
  15. Zhou, Shuchen, and Waqas Jadoon, "The partial computation offloading strategy based on game theory for multi-user in mobile edge computing environment," Computer Networks, Vol. 178, 107334, 2020.
  16. Honghe Huang, Yi Xu, Xiao Hua, Weixiong Yan, Yanjie Huang, "A crowdsourced system for robust eye tracking," Journal of Visual Communication and Image Representation, Vol. 60, pp. 28-32, 2019. https://doi.org/10.1016/j.jvcir.2019.01.007
  17. David A. Robinson, "A method of measuring eye movement using a scleral search coil in a magnetic field," IEEE Transactions on Bio-Medical Electronics, Vol. 10, Issue 4, pp.137-145, 1963. https://doi.org/10.1109/TBMEL.1963.4322822
  18. Yuka Yasui, Junko Tanaka, Masaki Kakudo, Masahiro Tanaka, "Relationship between preference and gaze in modified food using eye tracker," Journal of Prosthodontic Research, Vol. 63, Issue 2, pp. 210-215, 2019. https://doi.org/10.1016/j.jpor.2018.11.011
  19. Dan Witzner Hansen, Qiang Ji, "In the Eye of the Beholder: A Survey of Models for Eyes and Gaze," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 32, Issue 3, pp. 478-500, 2010. https://doi.org/10.1109/TPAMI.2009.30
  20. Mana Farshid, Jeannette Paschen, Theresa Eriksson, Jan Kietzmann, "Go boldly!: Explore augmented reality (AR), virtual reality (VR), and mixed reality (MR) for business," Business Horizons, Vol. 61, Issue 5, pp. 657-663, 2018. https://doi.org/10.1016/j.bushor.2018.05.009
  21. Cameron Wakefield, Henk-Evert Sonder, Wei Meng Lee, "The Microsoft .NET Framework," in VB.net Developer's Guide, 2001, pp. 33-89.
  22. Fabian Boemer, Yixing Lao, Rosario Cammarota, and Casimir Wierzynski, "nGraph-HE: A Graph Compiler for Deep Learning on Homomorphically Encrypted Data," in Proc. of the 16th ACM International Conference on Computing Frontiers, 2019, pp. 3-13.
  23. Scott Cyphers, Arjun K. Bansal, Anahita Bhiwandiwalla, Jayaram Bobba, Matthew Brookhart, Avijit Chakraborty, Will Constable, Christian Convey, Leona Cook, Omar Kanawi, Robert Kimball, Jason Knight, Nikolay Korovaiko, Varun Kumar, Yixing Lao, Christopher R. Lishka, Jaikrishnan Menon, Jennifer Myers, Sandeep Aswath Narayana, Adam Procter, Tristan J. Webb, "Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learning," 2018, ArXiv:1801.08058.
  24. Matic Perovsek, Janez Kranjc, Tomaz Erjavec, Bojan Cestnik, Nada Lavrac, "TextFlows: A visual programming platform for text mining and natural language processing," Science of Computer Programming, Vol. 121, pp. 128-152, 2016. https://doi.org/10.1016/j.scico.2016.01.001
  25. Baltasar Garcia Perez-Schofield, Francisco Ortin, "A didactic object-oriented, prototype-based visual programming environment," Science of Computer Programming, Vol. 176, pp. 1-13, 2019. https://doi.org/10.1016/j.scico.2019.02.004
  26. Barsoum. E, Kuester. F, "WebVR: An interactive web browser for virtual environments,", In Stereoscopic Displays and Virtual Reality Systems, Vol. 5664, pp. 540-547, 2005.
  27. J. Y. Xia, B. J. Xiao, Dan Li, K. R. Wang, "Improvement of virtual EAST system based on WebVR," Fusion Engineering and Design, Vol. 127, pp. 267-274, 2018. https://doi.org/10.1016/j.fusengdes.2018.01.024
  28. Wang Chun, Li Lei, Yuan Jiwu, Zhai Liangyun, Liu Gang, "Development of Emergency Drills System for Petrochemical Plants Based on WebVR," Procedia Environmental Sciences, Vol. 10, Part A, pp. 313-318, 2011. https://doi.org/10.1016/j.proenv.2011.09.051
  29. Dongwei Liu, Jie Peng, Yanyu Wang, Meijin Huang, Qianshan He, Yafei Yan, Bingxin Ma, Caijun Yue, "Implementation of interactive three-dimensional visualization of air pollutants using WebGL," Environmental Modelling & Software, Vol. 114, pp. 188-194, 2019 https://doi.org/10.1016/j.envsoft.2019.01.019
  30. Zakai, Alon, "Emscripten: an LLVM-to-JavaScript compiler," in Proc. of the ACM international conference companion on Object oriented programming systems languages and applications companion(OOPSLA '11), 2011, pp. 301-312.
  31. C. Lattner and V. Adve., "LLVM: A Compilation Framework for Lifelong Program Analysis & Transformation," in Proc. of the International Symposium on Code Generation and Optimization 2004(CGO 2004), 2004, pp. 75-86.
  32. llvm.org., LLVM Language Reference Manual, URL: http://releases.llvm.org/6.0.0/docs/LangRef.html, 2018.
  33. HAAS, Andreas, et al., "Bringing the web up to speed with WebAssembly," in Proc. of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation(PLDI 2017), 2017, pp. 185-200.
  34. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Meghan Cowan, Haichen Shen, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy, "TVM: An Automated End-to-End Optimizing Compiler for Deep Learning," in Proc. of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18), 2018, pp. 578-594.