• Journal of Broadcast Engineering
• /
• v.25 no.4
• /
• pp.545-559
• /
• 2020

In this paper, we propose a content creation framework that enables users without programming experience to easily create interactive media content that responds to user gestures. In the proposed framework, users define the gestures they use and the media effects that respond to them by numbers, and link them in a text-based configuration file. In the proposed framework, the interactive media content that responds to the user's gesture is linked with the dynamic projection mapping module to track the user's location and project the media effects onto the user. To reduce the processing speed and memory burden of the gesture recognition, the user's movement is expressed as a gray scale motion history image. We designed a convolutional neural network model for gesture recognition using motion history images as input data. The number of network layers and hyperparameters of the convolutional neural network model were determined through experiments that recognize five gestures, and applied to the proposed framework. In the gesture recognition experiment, we obtained a recognition accuracy of 97.96% and a processing speed of 12.04 FPS. In the experiment connected with the three media effects, we confirmed that the intended media effect was appropriately displayed in real-time according to the user's gesture.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.115-122
• /
• 2017

As the era of the fourth industrial revolution began, augmented reality showed infinite possibilities throughout society. However, current augmented reality systems such as head-mount display and hand-held display systems suffer from various problems such as weariness and nausea, and thus space-augmented reality, which is a projector-based augmented reality technology, is attracting attention. Spacial augmented reality requires precise tracking of dynamic objects to project virtual images in order to increase realism of augmented reality and induce user 's immersion. The infrared sensor-based precision tracking algorithm developed in this paper demonstrates very robust tracking performance with an average error rate of less than 1.5% and technically opens the way towards advanced augmented reality technologies such as tracking for arbitrary objects, and Socially, by easy-to-use tracking algorithms for non-specialists, it allows designers, students, and children to easily create and enjoy their own augmented reality content.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.9 no.8
• /
• pp.1709-1715
• /
• 2005

This paper describes the development of 3-D web graphic library for dynamic web graphic design. The 3-D web graphic library developed in this per supports creation of 3-D objects like cube and sphere objects, elimination of hidden line and surface, and the shading of diffuse and specular reflections. It provides, in drawing, perspective projection of an object depth first sort of multiple objects, and wire frame and solid models. It also supports texture mapping function for realistic and dynamic web application in application software. Each created 3-D object gives functions for the scaling, translation, and rotation of itself. It can be used for the development of dynamic web application software and the advertisement of information for business and tourism as a 3-D web graphic library engine. It is written in 'Java' language and runs on web browsers with Java virtual machine without any dependancy of client computer system.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.06a
• /
• pp.105-106
• /
• 2018

본 논문에서는 동적 프로젝션 맵핑을 구현하기 위하여 3차원 공간의 깊이 정보와 대상 객체의 색상영상에서의 특징점을 추출하여 3차원 공간상에서 움직이는 2차원 평면 객체의 자세를 안정적으로 추정하는 기법을 제안한다. 제안 기법은 타겟 이미지를 출력하여 타겟 이미지 보다 큰 평면 패널에 부착하고, 이 평면 패널을 3차원 공간상에서 움직이는 환경에서 타겟 이미지의 자세를 안정적으로 추정하기 위하여 고안되었다. 제안 기법에서는 우선 패널이 움직일 수 있는 깊이 영역을 지정하여 해당 깊이 영역에 존재하는 2차원 패널을 추출하고, 패널의 사각영역을 추출한다. 또한, 색상 영상에 SURF 알고리즘을 적용하여 2차원 평면상에 부착된 타겟 이미지의 영역을 색상 특징을 기반으로 함께 추출하여 패널의 사각 영역과 타겟 이미지의 상대적인 위치 정보를 추출한다. 셋업 단계에서 추출된 타겟 이미지의 상대적인 위치 정보를 이용하여, 조명의 변화에 의하여 순간적으로 타겟 이미지의 특징점 추적에 실패한 경우, 패널의 사각 영역에 의해 계산된 타겟 이미지의 상대적 위치 정보를 계산하여 자세 추정에 사용함으로써 움직이는 타겟 이미지의 3차원 자세를 안정적으로 추정할 수 있도록 하였다.