• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.8
• /
• pp.754-759
• /
• 2007

In this paper, we proposed the Bi-Modal Sensor Fusion Algorithm which is the emotional recognition method that be able to classify 4 emotions (Happy, Sad, Angry, Surprise) by using facial image and speech signal together. We extract the feature vectors from speech signal using acoustic feature without language feature and classify emotional pattern using Neural-Network. We also make the feature selection of mouth, eyes and eyebrows from facial image. and extracted feature vectors that apply to Principal Component Analysis(PCA) remakes low dimension feature vector. So we proposed method to fused into result value of emotion recognition by using facial image and speech.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.5
• /
• pp.59-66
• /
• 2019

According to the KT telecommunication statistics, people stayed inside their houses on an average of 11.9 hours a day. As well as, according to NSC statistics in the united states, people regardless of age are injured for a variety of reasons in their houses. For purposes of this research, we have investigated an abnormal event detection algorithm to classify infrequently occurring behaviors as accidents, health emergencies, etc. in their daily lives. We propose a fusion method that combines three classification algorithms with vision pattern, audio pattern, and activity pattern to detect unusual user events. The vision pattern algorithm identifies people and objects based on video data collected through home CCTV. The audio and activity pattern algorithms classify user audio and activity behaviors using the data collected from built-in sensors on their smartphones in their houses. We evaluated the proposed individual pattern algorithm and fusion method based on multiple scenarios.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.7
• /
• pp.639-645
• /
• 2010

This paper presents the sensor fusion algorithm that recognizes a primary vehicle by fusing radar and monocular vision data. In general, most of commercial radars may lose tracking of the primary vehicle, i.e., the closest preceding vehicle in the same lane, when it stops or goes with other preceding vehicles in the adjacent lane with similar velocity and range. In order to improve the performance degradation of radar, vehicle detection information from vision sensor and path prediction predicted by ego vehicle sensors will be combined for target classification. Then, the target classification will work with probabilistic association filters to track a primary vehicle. Finally the performance of the proposed sensor fusion algorithm is validated using field test data on highway.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.7
• /
• pp.1202-1208
• /
• 2008

This paper represents the multiple sensor fusion algorithm for the deep-sea unmanned underwater vehicles (UUV), composed of a remotely operated vehicle (ROV) 'Hemire' and a depressor 'Henuvy'. The performance of underwater positioning system usually highly depend on that of acoustic sensors such as ultra short base line(USBL), long base line(LBL) and altimeter. A practical sensor fusion algorithm is proposed in the sense of a moving window concept. The performance of the proposed algorithm can be observed by applying the algorithm to the Hemire sea trial data which was measured at the East Sea.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.5
• /
• pp.190-196
• /
• 2015

In this paper, we propose multiple location error compensation algorithm for GPS/INS fusion using kalman filter and introduce the way to reduce location error in 9-axis navigation devices for implementing inertial navigation technique. When evaluating location, there is an increase of location error. So navigation systems need robust algorithms to compensate location error in GPS/INS fusion. In order to improve robustness of 9-axis inertial sensor(mpu-9150) over its disturbance, we used tilt compensation method using compensation algorithm of acceleration sensor and Yaw angle compensation to have exact azimuth information of the object. And it shows improved location result using these methods combined with kalman filter.

• Journal of Information Processing Systems
• /
• v.12 no.1
• /
• pp.35-45
• /
• 2016

To resolve the problems of Poisson/impulse noise, blurriness, and sharpness in degraded X-ray images, a novel and efficient enhancement algorithm based on X-ray image fusion using a discrete wavelet transform is proposed in this paper. The proposed algorithm consists of two basics. First, it applies the techniques of boundary division to detect Poisson and impulse noise corrupted pixels and then uses the Wiener filter approach to restore those corrupted pixels. Second, it applies the sharpening technique to the same degraded X-ray image. Thus, it has two source X-ray images, which individually preserve the enhancement effects. The details and approximations of these sources X-ray images are fused via different fusion rules in the wavelet domain. The results of the experiment show that the proposed algorithm successfully combines the merits of the Wiener filter and sharpening and achieves a significant proficiency in the enhancement of degraded X-ray images exhibiting Poisson noise, blurriness, and edge details.

• Journal of Advanced Navigation Technology
• /
• v.15 no.5
• /
• pp.696-704
• /
• 2011

In this paper, we propose a mobile robot navigation algorithm using data fusion of a monocular camera and ultrasonic sensors. Threshold values for binary image processing are generated by a fuzzy inference method using image data and data of ultrasonic sensors. Threshold value variations improve obstacle detection for mobile robot to move to the goal under poor illumination environments. Obstacles detected by data fusion of camera and ultrasonic sensors are expressed on the grid map and avoided using the circular planning algorithm. The performance of the proposed method is evaluated by experiments on the Pioneer 2-DX mobile robot in the indoor room with poor lights and a narrow corridor.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.48 no.7
• /
• pp.513-522
• /
• 2020

This paper describes a relative navigation algorithm using PSD(Position Sensitive Detector) and heterogeneous sensor fusion. In order to perform relative navigation between a target and a chaser, a hardware system is constructed and simulations are conducted, using the relative navigation algorithm considering the hardware system. By analyzing errors through the simulations, advantages of using the heterogeneous sensor fusion are found. Finally, navigation performance is verified under an experimental environment established to obtain sensor data from the hardware system for data post-processing.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.10
• /
• pp.995-1005
• /
• 2011

An efficient outdoor local localization method is suggested using multi-sensor fusion with MU-EKF (Multi-Update Extended Kalman Filter) for car-like mobile robots. In outdoor environments, where mobile robots are used for explorations or military services, accurate localization with multiple sensors is indispensable. In this paper, multi-sensor fusion outdoor local localization algorithm is proposed, which fuses sensor data from LRF (Laser Range Finder), Encoder, and GPS. First, encoder data is used for the prediction stage of MU-EKF. Then the LRF data obtained by scanning the environment is used to extract objects, and estimates the robot position and orientation by mapping with map objects, as the first update stage of MU-EKF. This estimation is finally fused with GPS as the second update stage of MU-EKF. This MU-EKF algorithm can also fuse more than three sensor data efficiently even with different sensor data sampling periods, and ensures high accuracy in localization. The validity of the proposed algorithm is revealed via experiments.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.3
• /
• pp.229-235
• /
• 2011

To make a robust object tracking and identifying system for an intelligent robot and/or home system, heterogeneous sensor fusion between visible ray system and infrared ray system is proposed. The proposed system separates the object by combining the ROI (Region of Interest) estimated from two different images based on a heterogeneous sensor that consolidates the ordinary CCD camera and the IR (Infrared) camera. Human's body and face are detected in both images by using different algorithms, such as histogram, optical-flow, skin-color model and Haar model. Also the pose of human body is estimated from the result of body detection in IR image by using PCA algorithm along with AdaBoost algorithm. Then, the results from each detection algorithm are fused to extract the best detection result. To verify the heterogeneous sensor fusion system, few experiments were done in various environments. From the experimental results, the system seems to have good tracking and identification performance regardless of the environmental changes. The application area of the proposed system is not limited to robot or home system but the surveillance system and military system.