• Korean Journal of Computational Design and Engineering
• /
• v.16 no.4
• /
• pp.277-284
• /
• 2011

In tangible augmented reality (AR) environments for virtual prototyping, the user interacts with virtual products by manipulating tangible objects with his or her hands, but the user often encounter awkward situations in which his or her hands are occluded by augmented virtual objects, which reduces both immersion and ease of interaction. In this paper, we present how to resolve such hand region occlusion in order to enhance natural interaction and immersive visualization. In the AR environment considered, we use two types (product-type and pointer-type) of tangible objects for tangible user interaction with a virtual product of interest. Holding the tangible objects with his or her hands, the user can create input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. We developed a method for resolving hand region occlusion frequently arising during such user interaction, It first detect hand region in a real image and refines the rendered image of the virtual object by subtracting the hand region from the rendered image, Then, it superimposes the refined image onto the real image to obtain an image in which the occlusion is resolved. Incorporated into tangible AR interaction for virtual prototyping of handheld products such as cellular phones and MP3 players, the method has been found by a preliminary user study that it is not only useful to improve natural interaction and immersive visualization of virtual products, but also helpful for making the users experience the products' shapes and functions better.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.2
• /
• pp.325-332
• /
• 2022

In this study, real-time character navigation using AR lens developed by Nreal is developed. Real-time character navigation is not possible with general marker-based AR because NPC characters must guide while moving in an unspecified space. To replace this, a markerless AR system was developed using Digital Twin technology. Existing markerless AR is operated based on hardware such as GPS, gyroscope, and magnetic sensor, so location accuracy is low and processing time in the system is long, which results low reliability in real-time AR environment. In order to solve this problem, using the SLAM technique to construct a space into a 3D object and to construct a markerless AR based on point location, AR can be implemented without any hardware intervention in a real-time AR environment. This real-time AR environment configuration made it possible to implement a navigation system using characters in tourist attractions such as Suncheon Bay Garden and Suncheon Drama Filming Site.

• Smart Media Journal
• /
• v.13 no.4
• /
• pp.114-123
• /
• 2024

This paper proposes AR stone tower content, an experiential content based on wearable augmented reality (AR). Although wearable augmented reality is gaining attention, the acceptance of the technology is still focused on specialized applications such as industrial sites. On the other hand, the proposed AR stone tower content is based on the material of 'stone tower' so that general users can relate to it and easily participate in it, and it is organized to utilize space in a moving environment and find and stack stones based on natural hand gestures. The proposed AR stone tower content was implemented in the HoloLens 2 environment and evaluated by general users through a pilot exhibition in a small art museum. The evaluation results showed that the overall satisfaction with the content averaged 3.85, and the content appropriateness for the stone tower material was very high at 4.15. In particular, users were highly satisfied with content comprehension and sound, but somewhat less satisfied with object recognition, body adaptation, and object control. The above user evaluations confirm the resonance and positive response to the material, but also highlight the difficulties of the average user in experiencing and interacting with the wearable AR environment.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.6
• /
• pp.1275-1282
• /
• 2022

In this study, real-time character navigation using AR lens developed by Nreal is developed. Real-time character navigation is not possible with general marker-based AR because NPC characters must guide while moving in an unspecified space. To replace this, a markerless AR system was developed using Digital Twin technology. Existing markerless AR is operated based on hardware such as GPS, gyroscope, and magnetic sensor, so location accuracy is low and processing time in the system is long, resulting in low reliability in real-time AR environment. In order to solve this problem, using the SLAM technique to construct a space into a 3D object and to construct a markerless AR based on point location, AR can be implemented without any hardware intervention in a real-time AR environment. This real-time AR environment configuration made it possible to implement a navigation system using characters in tourist attractions such as Suncheon Bay Garden and Suncheon Drama Filming Site.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.2
• /
• pp.1-10
• /
• 2011

In this paper, we propose the algorithm for the AR(Augmented Reality) system, which is robust to the brightness change of light. In the proposed method, the histogram specification is achieved using the sample histogram, obtained from the frames in which the target objects could be detected successful. And When the object key-points couldn't be detected by the displacement of camera positions, the positions of non-detected key-points ware estimated using the linear KF(Kalman Filter). When the proposed algorithm is applied in the AR systems, the object key-points can be detected three times as much as the existing others. In addition, to prove the more efficiency of the proposed algorithm, we implemented the AR game, and could know that the performance is the more advanced than the others. The proposed algorithm can be used for the AR environments, which high efficiency is required such as the AR game, or the implementation of AR systems which are robust to the change of lights, etc.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.11a
• /
• pp.264-267
• /
• 2014

비행용 IoT 디바이스 중 하나인 Drone 은 사람이 수행하기 힘든 작업 등에 활용되면서 다양한 분야에서 주목 받고 있다. 현재 상용화가 많이 된 AR.Drone 은 기본 비행 관련 기능뿐만 아니라 GPS 센서를 이용한 정밀 비행 및 복귀, 카메라 센서 이용한 사물 추적(Object Tracking) 등의 여러 목적으로 활발히 개발이 이뤄지고 있다. 그러나 AR.Drone IoT 애플리케이션 개발은 전통적인 소프트웨어 개발과는 다르게 다양한 기술적 이슈가 발생한다. 본 논문에서는 AR.Drone IoT 애플리케이션 개발 시 발생하는 개발 및 실행 관련 기술적 이슈를 설명하고, 각 이슈의 필요성과 한계점, 발생하는 문제점들을 제시한다.

• Journal of the Institute of Convergence Signal Processing
• /
• v.12 no.4
• /
• pp.258-266
• /
• 2011

AR(Augmented Reality) technology is now easily shown around us with respect to its applicable areas' being spreaded into various shapes since the usage is simply generalized and many-sided. Currently existing camera vision based AR used marker based methods rather than using real world's informations. For the marker based AR technology, there are limitations on applicable areas and its environmental properties that a user could immerse into the usage of application program. In this paper, we proposed a novel AR method which users could recognize objects from the real world's data and the related 3-dimensional contents are also displayed. Those are done using image processing skills and a smart mobile embedded camera for terminal based AR implementations without any markers. Object recognition is done from the comparison of pre-registered and referenced images. In this process, we tried to minimize the amount of computations of similarity measurements for improving working speed by considering features of smart mobile devices. Additionally, the proposed method is designed to perform reciprocal interactions through touch events using smart mobile devices after the 3-dimensional contents are displayed on the screen. Since then, a user is able to acquire object related informations through a web browser with respect to the user's choice. With the system described in this paper, we analyzed and compared a degree of object recognition, working speed, recognition error for functional differences to the existing AR technologies. The experimental results are presented and verified in smart mobile environments to be considered as an alternate and appropriate AR technology.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.4 no.4
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.17 no.4
• /
• pp.1-11
• /
• 2021

In this paper, we explain the purpose of building a mobile app called "ARnetView" that can use the AR(augmented Reality)based calling function and AR based content creation function, and as well as an AR based data center that can share AR based video streaming and AR based contents on smartphones and tablet devices. For the AR(Augmented Reality) based data center implement, we have developed a mobile application and implemented a service system including an AR(augmented Reality) based calling function and AR based content production and AR based video streaming functions for real-time communication to connect a field technician and an expert so that the expert can see and discuss the situation in the field and technician and experts, they can draw digital annotation on mobile screen that accurately stick to 3D physical objects, allowing the expert to guide the technician step by step. In result, it provides a remote technical collaboration environment between field technician and expert. In addition, AR(Augmented Reality) collaboration service Platform was designed and implemented to increase work speed, efficiency, and utilization of advanced technicians, improve continuous productivity of equipment and facilities, maximize equipment and facility utilization, and strengthen industrial competitiveness. Therefore, through this, the AR collaboration service Platform can be applied to the industrial field, the medical field, and the entertainment/education field.

• Journal of Digital Contents Society
• /
• v.19 no.6
• /
• pp.1027-1032
• /
• 2018

Recently, new content for e-leisure, including e-sports and e-games, has become necessary. To meet this requirement, e-leisure mobile AR studies which track human are underway. The tracking performance at long distances is important because e-leisure mobile AR is used in outdoor environments. However, conventional mobile AR applications such as SNOW and Snapchat have the disadvantage of low tracking performance at long distances. Therefore, we propose an e-leisure mobile AR in outdoor environments. The proposed e-leisure mobile AR can estimate the position of the head in outdoor environments at long distances by using color markers and the human body ratio, and then augment a virtual object at the estimated position. The performance of the proposed e-leisure mobile AR was evaluated by measuring the tracking performance and processing time.