• 한국CDE학회논문집
• /
• 제16권4호
• /
• pp.277-284
• /
• 2011

In tangible augmented reality (AR) environments for virtual prototyping, the user interacts with virtual products by manipulating tangible objects with his or her hands, but the user often encounter awkward situations in which his or her hands are occluded by augmented virtual objects, which reduces both immersion and ease of interaction. In this paper, we present how to resolve such hand region occlusion in order to enhance natural interaction and immersive visualization. In the AR environment considered, we use two types (product-type and pointer-type) of tangible objects for tangible user interaction with a virtual product of interest. Holding the tangible objects with his or her hands, the user can create input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. We developed a method for resolving hand region occlusion frequently arising during such user interaction, It first detect hand region in a real image and refines the rendered image of the virtual object by subtracting the hand region from the rendered image, Then, it superimposes the refined image onto the real image to obtain an image in which the occlusion is resolved. Incorporated into tangible AR interaction for virtual prototyping of handheld products such as cellular phones and MP3 players, the method has been found by a preliminary user study that it is not only useful to improve natural interaction and immersive visualization of virtual products, but also helpful for making the users experience the products' shapes and functions better.

• 한국정밀공학회:학술대회논문집
• /
• 한국정밀공학회 2009년도 추계학술대회 논문집
• /
• pp.737-738
• /
• 2009

• 한국CDE학회논문집
• /
• 제13권3호
• /
• pp.209-216
• /
• 2008

This paper presents a novel approach to design evaluation of portable consumer electronic (PCE) products using augmented reality (AR) based tangible interaction and functional behavior simulation. In the approach, the realistic visualization is acquired by overlaying the rendered image of a PCE product on the real world environment in real-time using computer vision based augmented reality. For tangible user interaction in an AR environment, the user creates input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. For functional behavior simulation, we adopt state transition methodology to capture the functional behavior of the product into a markup language-based information model, and build a finite state machine (FSM) to controls the transition between states of the product based on the information model. The FSM is combined with AR-based tangible objects whose operation in the AR environment facilitates the realistic visualization and functional simulation of the product, and thus realizes faster product design and development. Based on the proposed approach, a product design evaluation system has been developed and applied for the design evaluation of various PCE products with highly encouraging feedbacks from users.

• 한국CDE학회논문집
• /
• 제13권2호
• /
• pp.77-88
• /
• 2008

Nowadays personal users create a variety of multi-media contents and share them with others through various devices over the Internet since the concept of user created content (UCC) has been widely accepted as a new paradigm in today's multi-media market, which has broken the boundary of contents providers and consumers. This paradigm shift has also introduced a new business model that makes it possible for them to create their own multi-media contents for commercial purpose. This paper proposes a tangible virtual studio using augmented reality to author multi-media contents easily and intuitively for personal broadcasting and personal content generation. It provides a set of tangible interfaces and devices such as visual markers, cameras, movable and rotatable arms carrying cameras, and miniaturized set. They can offer an easy-to-use interface in an immersive environment and an easy switching mechanism between tangible environment and virtual environment. This paper also discusses how to remove inconsistency between real objects and virtual objects during the AR-enabled visualization with a context-adaptable tracking method. The context-adaptable tracking method not only adjusts the locations of invisible markers by interpolating the locations of existing reference markers, but also removes a jumping effect of movable virtual objects when their references are changed from one marker to another.

• 한국CDE학회논문집
• /
• 제20권2호
• /
• pp.159-170
• /
• 2015

Radio-Frequency Identification (RFID) or Near Field Communication (NFC) technology has many advantages over other visual interfaces since it does not require line-of-sight alignment, can identify multiple tags simultaneously, and does not destroy the integrity of original objects. In addition, smart devices such as smartphone and smartpad have NFC/RFID readers which can provide mobile and natural interactions with digital and physical contents. Augmented reality has an excellent visual interaction capability with digital contents in a real environment by embedding digital contents into the physical world. In this paper, we propose a new approach to digital content interactions using RFID/NFC-based tangible interfaces in augmented reality environments that utilize invisible interfaces in addition to marker-based visual interfaces. By combining the advantages of invisible and visual interfaces, more intuitive interactions with digital contents can be provided, which can remove the difficulty of using typical AR paddles that are widely used in AR interactions. In particular, a semantic AR ontology is defined to provide more convenient interactions. Through the semantic ontology-based inferencing, physical querying and filtering are effectively supported. We will show the effectiveness and advantage of the proposed approach by demonstrating implementation results.

• 정보통신설비학회논문지
• /
• 제10권4호
• /
• pp.143-147
• /
• 2011

The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

• 전자공학회논문지CI
• /
• 제49권4호
• /
• pp.71-81
• /
• 2012

다양한 사용자들이 증강 현실을 쉽게 제작하기 위하여 3차원 물체의 추적 및 인식이 가능하도록 하기 위한 물체 등록과정이 직관적이고 간단하여야 한다. 물체 등록에 활용될 수 있는 다양한 3차원 재구성 방법이 개발되었지만, 아직은 실험적인 단계에 있다. 본 논문은 증강 현실 저작 시 다양한 사용자들에게 다양한 환경에서 직관적으로 활용될 수 있도록 하기 위한 3차원 재구성 방법으로써 마커를 활용하는 마커 기반 탠저블 인터페이스를 제안한다. 본 논문에서 제안하는 인터페이스를 이용하여 사용자가 물체의 표면을 직접 접촉함으로써 물체 여러 표면의 3차원 기하학 정보를 획득한다. 이 인터페이스를 이용하여 단순히 그래픽적인 모델링을 위한 3차원 재구성을 하는 것이 아니라 물체의 특징점 정보를 제공함으로써 증강현실에 활용할 수 있도록 한다. 최종적으로 제안하는 방법을 통하여 증강 현실 응용을 보임으로써 제안하는 방법의 효용성을 확인한다.

• 한국디자인학회:학술대회논문집
• /
• 한국디자인학회 2003년도 봄 학술발표대회논문집
• /
• pp.86-87
• /
• 2003

• 한국CDE학회논문집
• /
• 제17권6호
• /
• pp.417-425
• /
• 2012

In recent years, great attention has been paid to using simple physical objects as tangible objects to improve user interaction in augmented reality (AR) environments. In this paper, we address AR-based user interaction using tangible objects, which has been used as a key component for virtual design evaluation of engineered products including digital handheld products. We herein consider the use of two types (product-type and pointer-type) of tangible objects. The user creates input events by touching specified parts of the product-type object with the pointer-type object, and the virtual product reacts to the events by rendering its visual and auditory contents on the output devices. The product-type object is used to reflect the geometric shape of a product of interest and to determine its position and orientation in the AR environment. The pointer-type object is used to recognize the reference position of the pointer (or finger) in the same environment. The rapid prototype of the product is employed as a good alternative to the product-type object, but various alternatives to the pointer-type object can be considered according to fabrication process and touching mechanism. In this paper, we present four alternatives to the pointer-type object and investigate their strong and weak points by performing experimental comparison of their various aspects including interaction accuracy, task performance, and qualitative user experience.

• 디자인학연구
• /
• 제20권3호
• /
• pp.119-128
• /
• 2007

디지털 기술이 발전하면서 산업디자인 프로세스에 컴퓨터를 활용하는 CAID 필수적인 부분이 되었다. 3차원 모델을 렌더링 하여 사진과 같은 최종 이미지 결과물이 만들어내는 것은 CAID에 특화된 작업들 중 하나이다. 이 작업을 위해 디자이너는 가상 모델의 재질, 조명, 카메라 둥의 위치 및 세부 변수들을 적절히 조절하여야 한다. 기존 CAID도구의 사용자 인터페이스는 이러한 속성을 컴퓨터 그래픽 연산을 위한 변수 설정 창에서 주로 해결하고 있어 디자이너들이 사용하는데 어려움을 겪고 있다. 본 논문에서는 CAID를 위한 디지털 렌더링 작업 특히 라이팅과 관련된 인터페이스 문제를 해결하기 위해 증강현실(Augmented Reality)과 실체적 인터페이스(Tangible Interface)를 활용한 가상의 라이트 조작 도구, TLS(Tangible Lighting Studio)를 제안하였다. 이는 카메라의 위치 설정, 라이팅 효과를 위한 변수설정의 인터페이스를 실체화하고 작업공간에 분산시킴으로써 보다 직관적인 렌더링 작업을 지원하는 도구이다. TLS는 가상의 광원, 카메라, 렌더링 대상 등을 물리적으로 직접 조작할 수 있는 마커, 컨트롤러 유닛들, 사용자가 착용하는 비디오 투시형 HMD 등으로 구성된다. 이를 활용하여 사용자는 증강현실 작업공간에서 직접 라이팅 속성을 조정할 수 있다. 유용성 평가 실험을 통하여 TLS가 기존 CUI(Graphic User Interface)기반 시스템보다 유효성, 효율성 그리고 사용자 만족도가 높다는 점을 발견하였다. TLS는 CAID도구의 인터페이스 분야뿐만 아니라 광원과 카메라의 효과를 활용하는 건축, 사진 촬영 교육 등의 분야에서 효과적으로 활용될 수 있으리라 기대된다.