• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.4 no.4
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.05a
• /
• pp.297-299
• /
• 2017

Recently, the application fields of augmented reality(AR) are rapidly increasing, and related contents are also increasing in demand. In this way, object-based marker recognition is required for service of AR contents in mobile environment. At this time, in order to provide information corresponding to the marker, a technique of generating and servicing a virtual object corresponding to a specific marker is used. However, when a virtual object corresponding to a marker is held on the AR screen, a phenomenon occurs that an object of the marker unstably shakes due to various reasons such as camera shake and camera movement. As described above, the AR service based on the mobile device has a problem that it is difficult to represent objects stably. In this paper, we propose a stable marker recognition and tracking technique by applying the filtering technique according to the physical state change of the device when recognizing fixed markers in mobile AR environment.

• Journal of information and communication convergence engineering
• /
• v.20 no.1
• /
• pp.65-72
• /
• 2022

With the mark of the fourth industrial revolution, the smart factory is evolving into a new future manufacturing plant. As a human-machine-interactive tool, augmented reality (AR) helps workers acquire the proficiency needed in smart factories. The valuable data displayed on the AR device must be delivered intuitively to users. Current AR applications used in smart factories lack user movement calibration, and visual fiducial markers for position correction are detected only nearby. This paper demonstrates a marker-based object detection using perspective projection to adjust augmented content while maintaining the user's original perspective with displacement. A new angle, location, and scaling values for the AR content can be calculated by comparing equivalent marker positions in two images. Two experiments were conducted to verify the implementation of the algorithm and its practicality in the smart factory. The markers were well-detected in both experiments, and the applicability in smart factories was verified by presenting appropriate displacement values for AR contents according to various movements.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.05a
• /
• pp.288-290
• /
• 2017

Recently, interest and demand of Augmented Reality(AR) contents are increasing as an application field of AR. Generally, when the AR contents are served in the outdoor environment, the position information using the GPS signal is used to control the display of the object on the AR screen, or a marker based on the image of the object is used. However, there is a problem that location information can not be used in an indoor environment. If the service is provided using only the marker, there is a problem that the recognition of the marker due to the moving obstacle in the vicinity is unstable. and there is a problem that information displayed on the AR screen is not displayed in a fixed state at a specific position, it moves according to the movement of the camera. In this paper, we have studied the object control method for displaying the object to be displayed on the AR screen by using iBeacon using indoor location recognition and specific markers.

• ETRI Journal
• /
• v.35 no.6
• /
• pp.1048-1057
• /
• 2013

In recent years, augmented reality (AR) technologies have been the subject of great interest among many communities. In education applications, old-fashioned materials (or textbooks) are still used, despite remarkable AR developments in the industrial area. We present an AR system for education. Our system consists of an authoring tool that can be used to create educational content, a viewer that plays that content, and an engine to manage the tool and viewer. In our system, a marker unit recognizes a marker printed on a plane or a cubic plane by adaptively adjusting the threshold to have an excellent recognition rate in diverse environments and acquires corresponding data of the marker. Based on the system, we test 142 elementary school students for increased educational benefits using our system.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.6
• /
• pp.1275-1282
• /
• 2022

In this study, real-time character navigation using AR lens developed by Nreal is developed. Real-time character navigation is not possible with general marker-based AR because NPC characters must guide while moving in an unspecified space. To replace this, a markerless AR system was developed using Digital Twin technology. Existing markerless AR is operated based on hardware such as GPS, gyroscope, and magnetic sensor, so location accuracy is low and processing time in the system is long, resulting in low reliability in real-time AR environment. In order to solve this problem, using the SLAM technique to construct a space into a 3D object and to construct a markerless AR based on point location, AR can be implemented without any hardware intervention in a real-time AR environment. This real-time AR environment configuration made it possible to implement a navigation system using characters in tourist attractions such as Suncheon Bay Garden and Suncheon Drama Filming Site.

• Korean Journal of Computational Design and Engineering
• /
• v.18 no.5
• /
• pp.374-383
• /
• 2013

Various interaction techniques have been studied for providing the feeling of touch and improve immersion in augmented reality (AR) environments. Tangible AR interaction exploiting two types (product-type and pointer-type) of simple objects has earned great interest for cost-effective design evaluation of digital handheld products. When the sizes of markers attached to the objects are kept big to obtain better marker recognition, the pointer-type object frequently and significantly occludes the product-type object, which deteriorates natural visualization and level of immersion in an AR environment. In this paper, in order to overcome such problems, we propose tangible AR interaction using fingertip touch combined with small-sized markers. The proposed approach facilitates the use of convex polygons to recover the boundaries of AR markers which are partially occluded. It also properly enlarges the pattern area of each AR marker to reduce the sizes of AR markers without sacrificing the quality of marker detection. We empirically verified the quality of the proposed approach, and applied it in the process of design evaluation of digital products. From experimental results, we found that the approach is comparably accurate enough to be applied to the design evaluation process and tangible enough to provide a pseudo feeling of manipulating virtual products with human hands.

• Korean Journal of Computational Design and Engineering
• /
• v.17 no.3
• /
• pp.208-215
• /
• 2012

Augmented reality can help to improve user's engineering abilities such as perception and decision making in industry field. Therefore we have studied on the maintenance-supporting applications for inspectors previously. The advantage of pre-existing marker system is that the making and using are easier than any other feature tracking and detection methods. However it must to be exposed to the sufficient light to be detected by computer image processing. The most of industry field is not in clean environment and there are not sufficient light as well. So, the normal marker system is not appropriated for industrial fields. This paper suggests RFID-based marker system to improve marker-detection ability in our AR maintenance system. RFID is not implemented by image processing but it is implemented by electromagnetic induction. Therefore we could more precisely detect markers even if the environment is low-light intensity condition.

• Journal of Computational Design and Engineering
• /
• v.1 no.4
• /
• pp.289-297
• /
• 2014

Although big-sized markers are good for accurate marker recognition and tracking, they are easily occluded by other objects and deteriorate natural visualization and level of immersion during user interaction in AR environments. In this paper, we propose an approach to exploiting the use of rectangular markers to support tangible AR interaction based on fingertip touch using small-sized markers. It basically adjusts the length, width, and interior area of rectangular markers to make them more suitably fit to longish objects like fingers. It also utilizes convex polygons to resolve the partial occlusion of a marker and properly enlarges the pattern area of a marker while adjusting its size without deteriorating the quality of marker detection. We obtained encouraging results from users that the approach can provide better natural visualization and higher level of immersion, and be accurate and tangible enough to support a pseudo feeling of touching virtual products with human hands or fingertips during design evaluation of digital handheld products.

• Journal of the Korean Geographical Society
• /
• v.48 no.6
• /
• pp.994-1008
• /
• 2013

In this paper, we describe two exploratory examples in the use of Augmented Reality (AR) for geographical visualization regarding refinement of visual content in geography textbooks and learning motivation of geography students. Currently, teaching and learning materials with AR technology and their utilization in the geography classroom have become a new topic in geographical research themes, and this trend has increased. Adequate development and utilization of geographical materials is an important starting point for smart education research in geography. This paper describes the system and software, and the implication of marker AR applications for teaching and learning geography in the classroom. For the AR applications to be utilized in geography education, two marker based AR examples, virtual globe and visualization of topographical features, are presented and their utilization aspects are discussed. Finally, from the discussion stated in this paper, it can be inferred that AR is useful for exploring geographical materials, and marker based AR will contribute to progress in spatial science and geographical education research.