• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.38C no.10
• /
• pp.920-927
• /
• 2013

Chroma key technique which composes images by separating an object from its background in specific color has restrictions on color and space. Especially, unlike general chroma key technique, image composition for stereo 3D display requires natural image composition method in 3D space. The thesis attempted to compose images in 3D space using depth keying method which uses high resolution depth information. High resolution depth map was obtained through camera calibration between the DSLR and Kinect sensor. 3D mesh model was created by the high resolution depth information and mapped with RGB color value. Object was converted into point cloud type in 3D space after separating it from its background according to depth information. The image in which 3D virtual background and object are composed obtained and played stereo 3D images using a virtual camera.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.2
• /
• pp.483-503
• /
• 2014

In this paper, human action recognition using pyramid histograms of oriented gradients and collaborative multi-task learning is proposed. First, we accumulate global activities and construct motion history image (MHI) for both RGB and depth channels respectively to encode the dynamics of one action in different modalities, and then different action descriptors are extracted from depth and RGB MHI to represent global textual and structural characteristics of these actions. Specially, average value in hierarchical block, GIST and pyramid histograms of oriented gradients descriptors are employed to represent human motion. To demonstrate the superiority of the proposed method, we evaluate them by KNN, SVM with linear and RBF kernels, SRC and CRC models on DHA dataset, the well-known dataset for human action recognition. Large scale experimental results show our descriptors are robust, stable and efficient, and outperform the state-of-the-art methods. In addition, we investigate the performance of our descriptors further by combining these descriptors on DHA dataset, and observe that the performances of combined descriptors are much better than just using only sole descriptor. With multimodal features, we also propose a collaborative multi-task learning method for model learning and inference based on transfer learning theory. The main contributions lie in four aspects: 1) the proposed encoding the scheme can filter the stationary part of human body and reduce noise interference; 2) different kind of features and models are assessed, and the neighbor gradients information and pyramid layers are very helpful for representing these actions; 3) The proposed model can fuse the features from different modalities regardless of the sensor types, the ranges of the value, and the dimensions of different features; 4) The latent common knowledge among different modalities can be discovered by transfer learning to boost the performance.

• Journal of Korea Multimedia Society
• /
• v.13 no.4
• /
• pp.526-534
• /
• 2010

This paper describes an algorithm which merges two HDR pictures taken under different exposure time to display on the LDR devices such as LCD or CRT. The proposed method does not generate the radiance map, but directly merges using the weights computed from the input images. The weights are firstly produced on the pixel basis, and then blended with a Gaussian function. This process prevents some possible sparkle noises caused by radical change of the weights and contributes to smooth connection between 2 image informations. The chrominance informations of the images are merged on the weighted averaging scheme using the deviations of RGB average and their differences. The algorithm is characterized by the feature that it represents well the unsaturated area of 2 original images and the connection of the image information is smooth. The proposed method uses only 2 input images and automatically tunes the whole internal process according to them, thus autonomous operation is possible when it is included in HDR cameras which use double shuttering scheme or double sensor cells.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.1
• /
• pp.167-174
• /
• 2016

In this paper, we propose a generation of 2D elemental images for 3D objects using Kinect in 3D depth-priority integral imaging (DPII) display. First, we analyze a principle to pickup elemental images based on ray optics. Based on our analysis, elemental images are generated with both RGB image and depth image recorded from Kinect. We reconstruct 3D images from the elemental images with the computational integral imaging reconstruction technique and then compare various perspective images. To show the usefulness of the proposed method, we carried out the preliminary experiments. The experimental results reveal that our method can provide correct 3D images with full parallax.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.41 no.11
• /
• pp.1035-1045
• /
• 2017

Classification of age and gender has been carried out through different approaches such as facial-based and audio-based classifications. One of the limitations of facial-based methods is the reduced recognition rate over large distances, while another is the prerequisite of the faces to be located in front of the camera. Similarly, in audio-based methods, the recognition rate is reduced in a noisy environment. In contrast, gait-based methods are only required that a target person is in the camera. In previous works, the view point of a camera is only available as a side view and gait data sets consist of a standard gait, which is different from an ordinary gait in a real environment. We propose a feature extraction method using skeleton models from an RGB-D sensor by considering characteristics of age and gender using ordinary gait. Experimental results show that the proposed method could efficiently classify age and gender within a target group of individuals in real-life environments.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.23 no.12
• /
• pp.1528-1534
• /
• 2019

Recently, due to the popularization of 3D depth cameras, new researches and opportunities have been made in research conducted on RGB images, but estimation of human hand pose is still classified as one of the difficult topics. In this paper, we propose a robust estimation method of human hand pose from various input 3D depth images using a learning algorithm. The proposed approach first generates a skeleton-based hand model and then aligns the generated hand model with three-dimensional point cloud data. Then, using a random forest-based learning algorithm, the hand pose is strongly estimated from the aligned hand model. Experimental results in this paper show that the proposed hierarchical approach makes robust and fast estimation of human hand posture from input depth images captured in various indoor and outdoor environments.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.13 no.8
• /
• pp.3666-3671
• /
• 2012

We evaluate the face detection and recognition of depth image that is obtained by infrared range sensor. and Face recognition was usually focused on accuracy aspect but it is not enough to evaluate the performance in testing for real world application. In this paper, we evaluate the overall performance like accuracy, training, test speed and memory use for the well known face recognition algorithm like PCA, LDA, ICA and SVM. This experiment evaluate the good results of depth and colored depth image compatible with the colored image although the file size of depth and colored depth image is 30%~40% less than the colored image. Whereas, LDA got the good accuracy performance next to the SVM and also shows the good performance in speed and the amount of memory.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.3
• /
• pp.359-364
• /
• 2011

The study uses department of the sensitivity and fuzzy reasoning, one of artificial intelligence algorithms, so that develop LED lighting system based on fuzzy reasoning for systematical control of the LED color temperature. In the area of sensitivity engineering, by considering the relation between color and emotion expressed as an adjective word, the corresponding sensitivity word can be determined, By taking into consideration the relation between the brain wave measured from the human brain and the color temperature, the preferred lesson subject can be determined. From the decision of the sensitivity word and the lesson subject, we adjust the color temperature of RGB (Red, Green, Blue) LED. In addition, by using the information of the latitude and the longitude from GPS(Global Positioning System), we can calculate the on-line moving altitude of sun. By using the sensor information of both temperature and humidity, we can calculate the discomfort index. By considering the altitude of sun as well as the value of the discomfort index, the illumination of W(white) LED and the color temperature of RGB LED can be determined. The (LED) sensitivity lighting control system is bulit up by considering the sensitivity word, the lesson subject, the altitude of sun, and the discomfort index The developed sensitivity lighting control system leads to more suitable atmosphere and also the enhancement of the efficiency of lesson subjects as well as business affairs.

• Journal of Navigation and Port Research
• /
• v.39 no.4
• /
• pp.299-305
• /
• 2015

Modbus is a serial communications protocol, it has since become a practically standard communication protocol, and it is now a commonly available means of connecting industrial electronic devices. Therefore, it can be connected with all devices using Modbus protocol to the measurement and remote control on the ships, buildings, trains, airplanes and etc.. In this paper, we add the Modbus communication protocol to the existing lighting controller sensitivity to enable verification and remote control by external environmental factors, and also introduces a fuzzy inference system was configured by external environmental factors to control LED lighting. External environmental factors of temperature, humidity, illuminance value represented by the LED through a fuzzy control algorithm, the values accepted by the controller through the sensor. Modbus is using the RS485 Serial communication with other devices connected to the temperature, humidity, illumination and LED output status check is possible. In addition, the remote user is changed to enable it is possible to change the RGB values in the desired color change. Produced was confirmed that the LED controller output is based on the temperature, humidity and illumination.

• Korean Journal of Remote Sensing
• /
• v.37 no.5_1
• /
• pp.1013-1027
• /
• 2021

Images taken with KOMPSAT-3 have additional NIR and PAN bands, as well as RGB regions of the visible ray band, compared to imagestaken with a standard camera. Furthermore, electrical and optical properties must be considered because a wide radius area of approximately 17 km or more is photographed at an altitude of 685 km above the ground. In other words, the camera sensor of KOMPSAT-3 is distorted by each CCD pixel, characteristics of each band,sensitivity and time-dependent change, CCD geometry. In order to solve the distortion, correction of the sensors is essential. In this paper, we propose a method for detecting uniform regions in side-slider-based KOMPSAT-3 images using segment-based noise analysis. After detecting a uniform area with the corresponding algorithm, a correction table was created for each sensor to apply the non-uniformity correction algorithm, and satellite image correction was performed using the created correction table. As a result, the proposed method reduced the distortion of the satellite image,such as vertical noise, compared to the conventional method. The relative radiation accuracy index, which is an index based on mean square error (RA) and an index based on absolute error (RE), wasfound to have a comparative advantage of 0.3 percent and 0.15 percent, respectively, over the conventional method.