• Proceedings of the Korean Society of Computer Information Conference
• /
• 2013.07a
• /
• pp.381-383
• /
• 2013

This paper introduces what the interactive projection technology is, and how to use this technology to make a musical instrument. There have been many art works and business products completed by the interactive projection technology, but this technology seldom has been used in the musical field, so we want to make a simple instrument by interactive projection technology, and expect more people to develop this field in the future.

• Journal of Computational Design and Engineering
• /
• v.2 no.1
• /
• pp.26-37
• /
• 2015

A lot of researchers have been investigating interactive portable projection systems such as a mini-projector. In addition, in exhibition halls and museums, there is a trend toward using interactive projection systems to make viewing more exciting and impressive. They can also be applied in the field of art, for example, in creating shadow plays. The key idea of the interactive portable projection systems is to recognize the user's gesture in real-time. In this paper, a vision-based shadow gesture recognition method is proposed for interactive projection systems. The gesture recognition method is based on the screen image obtained by a single web camera. The method separates only the shadow area by combining the binary image with an input image using a learning algorithm that isolates the background from the input image. The region of interest is recognized with labeling the shadow of separated regions, and then hand shadows are isolated using the defect, convex hull, and moment of each region. To distinguish hand gestures, Hu's invariant moment method is used. An optical flow algorithm is used for tracking the fingertip. Using this method, a few interactive applications are developed, which are presented in this paper.

• Proceedings of the Korea Contents Association Conference
• /
• 2014.11a
• /
• pp.85-86
• /
• 2014

본 연구의 목적은 브랜드 홍보 잠재력이 낮아지고 있는 기업 브랜드의 아이덴터티 유지를 위한 도구로서 Projection Mapping의 활용 방안을 고찰하는 것이다. 브랜드 홍보 잠재력이 낮아지고 있는 지역 대표 기업인 기아 타이거즈를 연구 대상으로 선정하고, Brand Identity측면에서 Durability, Differentiation, Coherence, Flexibility 특성 중심으로 Interactive Projection Mapping을 구현하였다. 제작과정은 크게 C4d 를 활용한 홍보 영상 제작, VVVV와 Touch Sensor을 활용한 행동에 반응하는 영상 제어 과정으로 이루어졌다.

• The Journal of the Korea Contents Association
• /
• v.13 no.7
• /
• pp.1-8
• /
• 2013

As yet the use of 3D projection mapping facade has been limited to advertising and performance in the outside. And interactive elements are lacking. In this paper, propose a interaction system which control of projection mapping facade for multi-audience participation using smart devices. The system can be interaction for the multi-façade. And single or multiple can participate in the game. A user test based on the result confirmed an effectiveness of the proposed method. This research showed a practical method in which interaction of projection facade system can be used to user devices. The results of this study can be used as a base module for projection facade interaction system. In addition, It can be utilized for converged content development such as performances, games, education and various applications services.

• International Journal of Internet, Broadcasting and Communication
• /
• v.7 no.2
• /
• pp.41-50
• /
• 2015

As various media have developed in modern society, frequency of use of interactive media has increased which makes interactive function that uses and handles projection mapping and LED screen in set design of broadcasting, concert, play, musical and EDM(Electronic dance music) in real time possible. Development of various media led today's viewers to have higher cultural desire and the need of various interactive performance contents to receive more attention.[1]. This thesis implemented real time VJing that responds to user's motion based on existing H/W by utilizing real time interactive elements.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.1
• /
• pp.378-390
• /
• 2015

Image projectors can turn any surface into a display. Integrating a surface projection with a user interface transforms it into an interactive display with many possible applications. Hand gesture interfaces are often used with projector-camera systems. Hand detection through color image processing is affected by the surrounding environment. The lack of illumination and color details greatly influences the detection process and drops the recognition success rate. In addition, there can be interference from the projection system itself due to image projection. In order to overcome these problems, a gesture interface based on depth images is proposed for projected surfaces. In this paper, a depth camera is used for hand recognition and for effectively extracting the area of the hand from the scene. A hand detection and finger tracking method based on depth images is proposed. Based on the proposed method, a touch interface for the projected surface is implemented and evaluated.

• Journal of Korea Multimedia Society
• /
• v.10 no.9
• /
• pp.1135-1142
• /
• 2007

Front-projection type displays make it difficult to apply traditional skin color detection for human hand because the projected beam not only reaches to the screen but also to the user's hand. This paper solves this problem by modeling the distortion between original image and its final camera input. Our approach improves hand detection rate by modeling of interference effect among color channels and of intra-frame intensity and also by introducing adaptive threshold for color difference in skin region.

• Journal of Korea Game Society
• /
• v.5 no.1
• /
• pp.11-18
• /
• 2005

Recently, as one method of the game manipulation, physical interactive game is increasing, which controls the program by direct human movement. Tangible interface for physical interactive game implementation can control virtual model directly through real world object. A digital desk, one of the tangible interface, offers the interface that human can manipulate virtual object directly, by making projection screen on real world desk as computer display device. In this paper, we implement "Battle Region" game in the form of tangible interface, which can offer game users an efficient and amusing experiences by the use of physical interactive game. Traditional game cannot pursuit the diversity of game background contents but our game can do it through Map image projection. From this, game provider can supply the diversity of choice and users ran set up the difficulty of game. Therefore, our implemented game can offer users an efficient and amusing experiences by making game user's challenge and satisfaction maximum.

• Journal of KIISE:Software and Applications
• /
• v.37 no.1
• /
• pp.29-38
• /
• 2010

We propose an interactive projection technique to display details of a large image in a high resolution and brightness by tracking a portable projector. A closed-loop based tracking method is presented to update the projected image while a user changes the position of the detail area by moving the portable projector. A marker is embedded in the large image to indicate the position to be occupied by the detail image projected by the portable projector. The marker is extracted in sequential images acquired by a camera attached to the portable projector. The marker position in the large display image is updated under a constraint that the center positions of marker and camera frame coincide in every camera frame. The image and projective transformation for warping are calculated using the marker position and shape in the camera frame. The marker's four corner points are determined by a four-step segmentation process which consists of camera image preprocessing based on HSI, edge extraction by Hough transformation, quadrangle test, and cross-ratio test. The interactive projection system implemented by the proposed method performs at about 24fps. In the user study, the overall feedback about the system usability was very high.

• Journal of Korea Multimedia Society
• /
• v.20 no.2
• /
• pp.298-312
• /
• 2017

The fourth industrial revolution is expected to show technological innovation that develops among different fields beyond boundaries through the convergence and integration of fields. With the development and convergence of digital technology, users can receive information anywhere in the world. In this paper, we propose an adaptive interaction concept in a various environment by using a mobile robot based on projection augmented reality (AR). Most previous studies have aimed fixed projector or projection for a pre-designed environment. Thus, they provide only limited information. To overcome the abovementioned problem, we provide the adaptive information by implementing a projection AR system that can be mounted on the mobile robot. For that, the mobile robot based on the projection system was defined as Pervasive AR. Pervasive AR is configured with a pervasive display, a pervasive interface, and seamless interaction. The Pervasive AR technology enables the user to access information immediately by expanding the display area into real space, which implies an environment of intuitive and convenient interaction by expanding the user interface. This system can be applied to various areas, such as a home environment and a public space.