• Proceedings of the IEEK Conference
• /
• 2003.07d
• /
• pp.1279-1282
• /
• 2003

Estimation of human motion states is important enabling technologies for realizing a pervasive computing environment. In this paper, an improved method fur estimating human motion state from accelerometer data is introduced. Our method fur estimating human motion state utilizes various statistics of accelerometer data, such as mean, standard variation, skewness, kurtosis, eccentricity, as features for classification, and therefore is expected to be more robust than other existing methods that rely on only a few simple statistics. A series of experiments fur testing the effectiveness of the proposed method has been performed, and its result is presented.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.11 no.5
• /
• pp.277-285
• /
• 2016

Moving object detection system has been an emerging research field in various advanced driver assistance systems (ADAS) and surveillance system. In this paper, we propose two optical flow based moving object detection methods at dynamic scenes. Both proposed methods consist of three successive steps; pre-processing, foreground segmentation, and post-processing steps. Two proposed methods have the same pre-processing and post-processing steps, but different foreground segmentation step. Pre-processing calculates mainly optical flow map of which each pixel has the amplitude of motion vector. Dense optical flows are estimated by using Farneback technique, and the amplitude of the motion normalized into the range from 0 to 255 is assigned to each pixel of optical flow map. In the foreground segmentation step, moving object and background are classified by using the optical flow map. Here, we proposed two algorithms. One is Gaussian mixture model (GMM) based background subtraction, which is applied on optical map. Another is adaptive thresholding based foreground segmentation, which classifies each pixel into object and background by updating threshold value column by column. Through the simulations, we show that both optical flow based methods can achieve good enough object detection performances in dynamic scenes.

• ETRI Journal
• /
• v.45 no.5
• /
• pp.836-846
• /
• 2023

Mobile robots are used in modern life; however, object recognition is still insufficient to realize robot navigation in crowded environments. Mobile robots must rapidly and accurately recognize the movements and shapes of pedestrians to navigate safely in pedestrian-rich spaces. This study proposes real-time, accurate, three-dimensional (3D) multi-pedestrian detection and tracking using a 3D light detection and ranging (LiDAR) point cloud in crowded environments. The pedestrian detection quickly segments a sparse 3D point cloud into individual pedestrians using a lightweight convolutional autoencoder and connected-component algorithm. The multi-pedestrian tracking identifies the same pedestrians considering motion and appearance cues in continuing frames. In addition, it estimates pedestrians' dynamic movements with various patterns by adaptively mixing heterogeneous motion models. We evaluate the computational speed and accuracy of each module using the KITTI dataset. We demonstrate that our integrated system, which rapidly and accurately recognizes pedestrian movement and appearance using a sparse 3D LiDAR, is applicable for robot navigation in crowded spaces.

• Journal of Broadcast Engineering
• /
• v.13 no.5
• /
• pp.681-684
• /
• 2008

We proposed a method to improve moving object detection capability of Gaussian Mixture Model by suggesting shape adaptive bidirectional block matching algorithm. This method achieves more accurate detection and tracking performance at various motion types such as slow, fast, and bimodal motions than that of Gaussian Mixture Model. Experimental results showed that the proposed method outperformed the conventional methods.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.9
• /
• pp.1120-1131
• /
• 2016

In this paper, we propose a smoker recognition algorithm, detecting smokers in a video sequence in order to prevent fire accidents. We use description-based method in hierarchical approaches to recognize smoker's activity, the algorithm consists of background subtraction, object detection, event search, event judgement. Background subtraction generates slow-motion and fast-motion foreground image from input image using Gaussian mixture model with two different learning-rate. Then, it extracts object locations in the slow-motion image using chain-rule based contour detection. For each object, face is detected by using Haar-like feature and smoke is detected by reflecting frequency and direction of smoke in fast-motion foreground. Hand movements are detected by motion estimation. The algorithm examines the features in a certain interval and infers that whether the object is a smoker. It robustly can detect a smoker among different objects while achieving real-time performance.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.14 no.1
• /
• pp.77-85
• /
• 2018

This paper proposes a robust digital video stabilization algorithm to extract and track an object, which uses a phase correlation-based motion correction. The proposed video stabilization algorithm consists of background stabilization based on motion estimation and extraction of a moving object. The motion vectors can be estimated by calculating the phase correlation of a series of frames in the eight sub-images, which are located in the corner of the video. The global motion vector can be estimated and the image can be compensated by using the multiple local motions of sub-images. Through the calculations of the phase correlation, the motion of the background can be subtracted from the former frame and the compensated frame, which share the same background. The moving objects in the video can also be extracted. In this paper, calculating the phase correlation to track the robust motion vectors results in the compensation of vibrations, such as movement, rotation, expansion and the downsize of videos from all directions of the sub-images. Experimental results show that the proposed digital image stabilization algorithm can provide continuously stabilized videos and tracking object movements.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.5
• /
• pp.191-198
• /
• 2013

This paper proposes detection of view reversal in a stereo video using depth map and motion vector information. We obtain a depth map by using a stereo matching and divide the input image into foreground and background. Next, we obtain a motion vector field by using a motion estimation. In general, an occluded region is in background when foreground goes toward the adjacent background or the background goes toward the adjacent foreground. But, we will face with the change of foreground and background because their depths also change when view reversal occurs. Therefore, we can detect the view reversal in stereo videos by using the observation that the foreground goes toward the adjacent background or the background goes toward the adjacent foreground. The experimental results show that the proposed algorithm achieves good detection rate when the background region is sufficiently occluded by the moving foreground.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.82-86
• /
• 2004

A fuzzy rule-based hand-motion estimation algorithm is proposed for a 6 dimensional spatial tracker in which low cost accelerometers and gyros are employed. To be specific, beginning and stopping of hand motions needs to be accurately detected to initiate and terminate integration process to get position and pose of the hand from accelerometer and gyro signals, since errors due to noise and/or hand-shaking motions accumulated by integration processes. Fuzzy rules of yes or no of hand-motion-detection are here proposed for rules of accelerometer signals, and sum of derivatives of accelerometer and gyro signals. Several experimental results and shown to validate our proposed algorithms.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.383-388
• /
• 2005

Depth recovery in robot vision is an essential problem to infer the three dimensional geometry of scenes from a sequence of the two dimensional images. In the past, many studies have been proposed for the depth estimation such as stereopsis, motion parallax and blurring phenomena. Among cues for depth estimation, depth from lens translation is based on shape from motion by using feature points. This approach is derived from the correspondence of feature points detected in images and performs the depth estimation that uses information on the motion of feature points. The approaches using motion vectors suffer from the occlusion or missing part problem, and the image blur is ignored in the feature point detection. This paper presents a novel approach to the defocus technique based depth from lens translation using sequential SVD factorization. Solving such the problems requires modeling of mutual relationship between the light and optics until reaching the image plane. For this mutuality, we first discuss the optical properties of a camera system, because the image blur varies according to camera parameter settings. The camera system accounts for the camera model integrating a thin lens based camera model to explain the light and optical properties and a perspective projection camera model to explain the depth from lens translation. Then, depth from lens translation is proposed to use the feature points detected in edges of the image blur. The feature points contain the depth information derived from an amount of blur of width. The shape and motion can be estimated from the motion of feature points. This method uses the sequential SVD factorization to represent the orthogonal matrices that are singular value decomposition. Some experiments have been performed with a sequence of real and synthetic images comparing the presented method with the depth from lens translation. Experimental results have demonstrated the validity and shown the applicability of the proposed method to the depth estimation.

• Proceedings of the KIEE Conference
• /
• 2008.07a
• /
• pp.1735-1736
• /
• 2008

In this research, a riding robot system named as "RideBot" is developed for health-care and entertainments. The developed riding robot can follow the intention of horseman and can simulate the motion of horse. The riding robot mechanisms are used for many functions of attitude detection, motion sensing, recognition, common interface and motion-generations. This riding robot can react on health conditions, bio-signals and intention informations of user. One of the objectives of this research is that the riding robot could catch user motion and operate spontaneous movements. In this paper, we develope the saddle mechanism which can generate 3 degrees-of-freedom riding motion based on the intention of horseman. Also, we develope reins and spur mechanism for the recognition of the horseman's intention estimation and the bio-signal monitoring system for the health care function of a horseman. In order to evaluate the performance of the riding robot system, we tested several riding motions including slow and normal step motion, left and right turn motion.