• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.6
• /
• pp.718-723
• /
• 2011

In this paper, we propose a visual multi-touch air input device using vision cameras. The implemented device provides a barehanded interface which copes with the multi-touch operation. The proposed device is easy to apply to the real-time systems because of its low computational load and is cheaper than the existing methods using glove data or 3-dimensional data because any additional equipment is not required. To do this, first, we propose an image processing algorithm based on the HSV color model and the labeling from obtained images. Also, to improve the accuracy of the recognition of hand gestures, we propose a motion recognition algorithm based on the geometric feature points, the skeleton model, and the Kalman filter. Finally, the experiments show that the proposed device is applicable to remote controllers for video games, smart TVs and any computer applications.

• Journal of Intelligence and Information Systems
• /
• v.16 no.2
• /
• pp.95-108
• /
• 2010

In this paper, we present a hybrid neural network model for dynamic hand gesture recognition. The model consists of two modules, feature extraction module and pattern classification module. We first propose a modified CNN(convolutional Neural Network) a pattern recognition model for the feature extraction module. Then we introduce a weighted fuzzy min-max(WFMM) neural network for the pattern classification module. The data representation proposed in this research is a spatiotemporal template which is based on the motion information of the target object. To minimize the influence caused by the spatial and temporal variation of the feature points, we extend the receptive field of the CNN model to a three-dimensional structure. We discuss the learning capability of the WFMM neural networks in which the weight concept is added to represent the frequency factor in training pattern set. The model can overcome the performance degradation which may be caused by the hyperbox contraction process of conventional FMM neural networks. From the experimental results of human action recognition and dynamic hand gesture recognition for remote-control electric home appliances, the validity of the proposed models is discussed.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.10
• /
• pp.1155-1166
• /
• 2016

In this paper, we propose a new embedded video compression scheme which uses three-dimensional rate-distortion optimization based block coder. After the proposed scheme removes temporal redundancy by applying the motion compensated temporal filtering(MCTF) on input video frames, two dimensional discrete wavelet transform is applied on video frames to remove spatial redundancy. The three-dimensional wavelet coefficients generated in this way are sorted according to their expected rate-distortion slope and encoded by using the three-dimensional block partition coding method. The proposed scheme also uses both the effective color video coding method which maintains embedded features, and the efficient bit-rate control method. Experimental results demonstrate that the proposed scheme not only produces embedded bit-streams, but also outperforms existing video compression schemes.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.2
• /
• pp.1381-1387
• /
• 2015

This paper proposes a sketch drawing system called m-shaper for musical shape generation. Through simple sketch drawing, users can generate musical shape configuration which can be played by a computer. One key ingredient of the process is a unique concept for the interactive musical shape generation that combines shape and sound based on the designers' manual inputs. m-shaper captures the numerical values of drawing characteristics and determines how the musical notes and shapes can be generated. Using a tablet, four sketch movements are captured such as pressure, tilt, rotation and speed. Each point of a shape corresponds to a certain musical note that represents a type of instrument, duration, pitch, and octave. The current m-shaper has been developed as a computational tool for supporting the schematic design process. Designers in m-shaper draw geometric sketches with a musical inspiration and explore possible conceptual forms. They also can control the parameters for results and transform their sketch drawing.

• Journal of Korea Multimedia Society
• /
• v.12 no.8
• /
• pp.1089-1098
• /
• 2009

Recently, many researches of making more comfortable input device based on gaze detection technology have been performed in human computer interface. Previous researches were performed on the computer environment with a large sized monitor. With recent increase of using mobile device, the necessities of interfacing by gaze detection on mobile environment were also increased. In this paper, we research about the gaze detection method by using UMPC (Ultra-Mobile PC) and an embedded camera of UMPC based on face and facial feature detection by AAM (Active Appearance Model). This paper has following three originalities. First, different from previous research, we propose a method for tracking user's gaze position in mobile device which has a small sized screen. Second, in order to detect facial feature points, we use AAM. Third, gaze detection accuracy is not degraded according to Z distance based on the normalization of input features by using the features which are obtained in an initial user calibration stage. Experimental results showed that gaze detection error was 1.77 degrees and it was reduced by mouse dragging based on the additional facial movement.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.5
• /
• pp.674-682
• /
• 2009

The modular robot is one which was developed to get over limit of the space movement for the mobile robot. The chain type robot in particular is connected by series each other and this form expression method is simple and easy to really make a docking method efficiently. However, the related studies were focused on the movement that used to be combination, and the movement of a cell independent mainly does not consist and have a problem to dock only in a direction, not to be connected with all directions. Therefore, we suggested a modular structure for quick, independent movement to solve such a problem and had own autonomy. In addition, we are intended to get some effectiveness for connection mechanism using one locking motor. In this paper, we dealt with the design for the mechanical and electrical points and docking algorithm including communication method. All of the structure is verified with real action experiment through the shape expressions of various application platform.

• Advanced Industrial SCIence
• /
• v.1 no.1
• /
• pp.23-31
• /
• 2022

Cloud services, which started in the early 2000s as a method of using idle servers, are more active with the advent of the 4th industrial revolution, and are being used in many fields as an optimal platform that can be used for business by collecting and analyzing data. On the other hand, the Internet of Things is an environment in which all surrounding objects can freely connect to the Internet network anytime and anywhere to transmit sensed data. In the Internet of Things, data is transmitted in real time, so BaaS, that is, a cloud service for data only has been added. In this paper, among BaaS services for the Internet of Things, a back-end service method that manages data based on Parse Server is explained, and a service that helps patients in rehabilitation is presented using this. For this, a Raspberry Pi is used as a hardware environment, and it is connected to the Internet, collects patient movement information in real time, and manages it through the Parse Server.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.5
• /
• pp.747-752
• /
• 2023

This study is about interaction design types in the production of sensor-based media installations combining Arduino, an open source platform. By typifying the realized media installation works, we seek to explore the diversity and meaning of new media art expression methods. Based on the understanding of the interaction method of media art, the interaction design type in the production of media installation using sensors was divided into physical movement through motor control, 'artificial plants using ultrasonic sensors and motors', and 'virtual garden using light and sound sensors'. 'Moving images using tilt sensors' are classified into four types. Through this, it is expected that media software can be selected as an appropriate technology for the work and can be presented as an example of artistic expression that is evolving into various expressions.

• Journal of Digital Contents Society
• /
• v.13 no.1
• /
• pp.119-127
• /
• 2012

In this study, it was witnessed that a variety of tests are implemented in a type of convergence of multimedia such as photos, sounds, and videos as well as letters and drawings, components of existing traditional comics as comics are digitalized and are converted to various devices. Therefore, we studied the concept of multimedia comics as a basis of this study by judging that new barometer to comics lies in convergence with such multimedia. After recognizing components of multimedia comics which are currently emerging, we categorized them into three types depending on how to use these elements. First, convergence type webtoon has a very similar format with existing vertical scrolling webtoon and has characteristics that background & effects sounds are added to emphasize the features of webtoon, or photos or videos are inserted in part, and there is no function to control these elements; Second, motion comic, a medium format between comic and animation has a characteristic that sound, video, paging are auto-played like watching animation but it keeps the format of comics within one frame; Third, interactive comic has a characteristic that effects sound, motion, and story are made by active participation of viewers. As a result of analyzing comics which having above multimedia characteristics, its implications are as followings: First, multimedia elements should be used depending on genre, age, and media; Second, high level of control technology considering the features of comic-viewers is needed. In other words, in continuously evolving media environments, comic contents being proper to targets and use purposes of viewers should be developed. For this, multimedia elements of comics should be used in order that comic-viewers can have active & interactive communication with contents.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.4
• /
• pp.429-434
• /
• 2012

This paper presents a technology for manipulating external devices by Brain Computer Interface (BCI) system. Recently, BCI based rehabilitation and assistance system for disabled people, such as patient of Spinal Cord Injury (SCI), general paralysis, and so on, is attracting tremendous interest. Especially, electroencephalogram (EEG) signal is used to organize the BCI system by analyzing the signals, such as evoked potential. The general findings of neurophysiology support an availability of the EEG-based BCI system. We concentrate on the event-related synchronization of motor imagery EEG signal, which have an affinity with an intention for moving control of external device. To analyze the brain activity, short-time Fourier transform and particle swarm optimization are used to optimal feature selection from the preprocessed EEG signals. In our experiment, we can verify that the power spectral density correspond to range mu-rhythm(${\mu}8$~12Hz) have maximum amplitude among the raw signals and most of particles are concentrated in the corresponding region. Result shows accuracy of subject left hand 40% and right hand 38%.