• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.77-85
• /
• 2017

Tangible Space is a new emerging interaction space with mobile AR/VR computing and ubiquitous computing environment with IoT. Tangible Space spans from a physical environment augmented with virtual entities to immersive virtual environments mirroring the physical environment. Interacting with Tangible Space is logged just like interacting with the Web. By webizing Tangible Space, we can gain persistence as a by-product so that human life experience in the physical environment can be logged and shared just like the information being created and shared in the current Web. The result is a powerful future direction of the web from a World Wide Web of Information to World Wide Web of Life experiences.

• The KIPS Transactions:PartB
• /
• v.13B no.5 s.108
• /
• pp.499-506
• /
• 2006

This Paper describes a fast and stable camera pose estimation method for real-time augmented reality systems. From the feature tracking results of a marker on a single frame, we estimate the camera rotation matrix and the translation vector. For the camera pose estimation, we use the shape factorization method based on the scaled orthographic Projection model. In the scaled orthographic factorization method, all feature points of an object are assumed roughly at the same distance from the camera, which means the selected reference point and the object shape affect the accuracy of the estimation. This paper proposes a flexible and stable selection method for the reference point. Based on the proposed method, we implemented a video augmentation system that inserts virtual 3D objects into the input video frames. Experimental results showed that the proposed camera pose estimation method is fast and robust relative to the previous methods and it is applicable to various augmented reality applications.

• Journal of The Korean Association For Science Education
• /
• v.40 no.2
• /
• pp.191-201
• /
• 2020

This study investigated verbal and physical interactions which appeared in collaborative science concept learning using augmented reality. Twelve 10th grade students participated in this study. After being organized into three four-member small groups, they participated in classes using smart device-based augmented reality application developed for the understanding of the chemical bonding concept. Their class activities were audio- and video-taped. Semi-structured interviews were also conducted. The results revealed that within individual statement units of verbal interaction, the proportions of information question/explanation and direction question/explanation were found to be high. Within interaction units, the proportions of reformative and cumulative interaction were relatively high. The proportions of progress were also found to be high within both individual statement units and interaction units of verbal interaction. Students' physical interactions were mainly conducted without meaningful verbal interactions. When their physical interactions were accompanied by knowledge construction-related verbal interactions, the proportions of gazing virtual objects and worksheet-related interactions were high. In contrast, various exploratory activities related to the manipulation of markers mainly appeared when they conducted physical interactions only, or when their physical interactions were accompanied by management-related verbal interactions. On the bases of the results, effective methods for collaborative concept learning using augmented reality in science education are discussed.

• Journal of the HCI Society of Korea
• /
• v.2 no.2
• /
• pp.45-51
• /
• 2007

Space planning is one of the popular applications of VR technology including interior design, architecture design, and factory layout. In order to provide easier methods to accommodate physical objects into virtual space planning task, we suggest applying mixed reality (MR) interface. We describe our hardware and software of our MR system designed according to requirements of the application domain. In brief, our system hardware consists of a video see-through display with a touch screen interface, mounted on a mobile platform, and we use screen space 3D manipulations to arrange virtual objects within the MR scene. Investigating the interface with our prototype implementation, we are convinced that our system will help users to design spaces in more easy and effective way.

• Journal of Korea Multimedia Society
• /
• v.21 no.5
• /
• pp.626-637
• /
• 2018

Human exchanges information not only through words, but also through body gesture or hand gesture. And they can be used to build effective interfaces in mobile, virtual reality, and augmented reality. The past 2D gesture recognition research had information loss caused by projecting 3D information in 2D. Since the recognition of the gesture in 3D is higher than 2D space in terms of recognition range, the complexity of gesture recognition increases. In this paper, we proposed a real-time gesture recognition deep learning model and application in 3D space using deep learning technique. First, in order to recognize the gesture in the 3D space, the data collection is performed using the unity game engine to construct and acquire data. Second, input vector normalization for learning 3D gesture recognition model is processed based on deep learning. Thirdly, the SELU(Scaled Exponential Linear Unit) function is applied to the neural network's active function for faster learning and better recognition performance. The proposed system is expected to be applicable to various fields such as rehabilitation cares, game applications, and virtual reality.

• International journal of advanced smart convergence
• /
• v.7 no.2
• /
• pp.135-142
• /
• 2018

Virtual reality (VR) technology has been increasingly more frequently used day by day in industries, entertainment and performances due to the development of AR and MR technologies. Performance arts also actively utilize $360^{\circ}$ VR technology due to the free expression of stage settings and auditoriums. However, technologies for systems in which performers wear VR devices firsthand rather than being in the sandpoint of bystanders while audiences wear VR head mounted displays(HMDs) to see performance stages have been rarely studied yet. This study investigated the technical possibilities of possible methods of expression that will enable performers to appear on the stage wearing VR devices. Since VR can maximize the sense of immersion with its closed HMD structure unlike augmented reality (AR), VR was judged to be suitable for studies centered on the mental interactions in the inner side of humans. Among them, to implement shamanistic expression methods with the phantoms of the body and soul, a motion capture technology linked with VR display devices and real-time cameras was realized on the stage. In this process, the importance of body ownership experienced by the performers (participants), reactions when they lost it, and the mental phenomena of the desire to possess the subjects of gaze could be seen. In addition, high possibility of development of this technology hereafter could be expected because this technology includes the technical openness that enables the audience to appear on the stage firsthand to become performers.

• Journal of Sensor Science and Technology
• /
• v.28 no.1
• /
• pp.52-57
• /
• 2019

Studies to augment emotion and immersion in multimedia content through olfactory stimulation are being increasingly conducted in the past two decades, and a variety of scent devices have been developed. Most of the scent devices are very large and heavy; consequently, they are installed on a table rather than being attached to the Head-mounted Display (HMD). Even if such devices are mounted on the HMD, it is not possible to control the scent density because of the size limitation, and it is not easy to be immersed in the experience because of the noise caused by the scent device. In order for an actual virtual reality or an augmented reality system to work efficiently with the scent device, three conditions - noiseless, a compact design, and concentration control- must be satisfied. In this study, we design a scent device that satisfies these three conditions. By using a miniature piezoelectric pump, a small size scent device is designed so that it can be easily attached to the lower end of the HMD, and hardly any noise is generated. Moreover, it is possible to control the concentration of the scent by controlling the piezoelectric pump using amplitude and frequency.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.47 no.1
• /
• pp.123-134
• /
• 2010

In this paper we propose ubiquitous virtual reality framework and its application for fostering a sustainable content ecosystem in the convergence space of virtual reality and real space. The ubiquitous virtual reality framework supports fundamental infrastructure which consists of platforms for end-users and service providers and dual space management. The platform for the service provider allows experts to generate contents related to real objects while the platform for the end-users allows to consume, share and regenerate the contents contextually augmented over real objects. The dual space management stores, visualizes and provides the contents generated and extended by them for connecting different users and service providers. The proposed framework allows users to continuously generate, share and extend the contents and thus contribute to making multimedia service environment. We also implemented and evaluated the framework consisting of a desktop authoring platform, mobile authoring platform and a dual space management server. We then introduced a promising application scenario to show how the content ecosystem is empowered by ubiquitous virtual reality framework and is realized in our life. Consequently, we are expecting that the ubiquitous virtual reality technology will play a vital role in building continuously evolving multimedia service environment for the future computing environment.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.1093-1099
• /
• 2022

The number of buildings is increasing day by day. The next logical footstep is tackling challenges regarding scarcity of resources and sustainability, as well as shifting focus on existing building structures to renovate and retrofit. Many existing old and heritage buildings lack documentation, such as building models, despite their necessity. Technological advances allow us to use virtual reality, augmented reality, and mixed reality on mobile platforms in various aspects of the construction industry. For these purposes, having a BIM model or high detail 3D model is not always necessary, as a simpler model can serve the purpose within many mobile platforms. This paper streamlines a framework for generating a lightweight 3D model for mobile platforms. In doing so, we use an existing structure's site survey data for the foundation data, followed by mobile VR implementation. This research conducted a pilot study on an existing building. The study provides a process of swiftly generating a lightweight 3D model of a building with relative accuracy and cost savings.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2024.01a
• /
• pp.63-66
• /
• 2024

최근에 국내외 실감형 콘텐츠 산업의 가파른 성장에 따른 실감콘텐츠산업에 대한 관심이 높아지고 있은 상황에서 VR, AR, XR 시장은 혁신적인 변화를 주도하고 있다. 실감형 기잔의 기기의 게임들은 기존의 게임과는 다른 방식의 품질보증(QA) 접근 방식을 요구한다. 전통적인 2D 게임과 달리 물리적 상호작용과 환경 인식 기능같은 부분이 다르기 때문이다. 본 논문에서는 가상현실, 증강현실, 확장현실 기반의 게임에 대해서 테스트 시 각 기기마다 고려해야 할 사항들에 대한 내용들을 제시하고 해당 사항들에 대해서 효과적인 방안을 제시해본다.