• Journal of Internet Computing and Services
• /
• v.21 no.5
• /
• pp.67-73
• /
• 2020

In this paper, we present a CNN-based gesture recognition approach which reduces the memory burden of input data. Most of the neural network-based gesture recognition methods have used a sequence of frame images as input data, which cause a memory burden problem. We use a motion history image in order to define a meaningful gesture. The motion history image is a grayscale image into which the temporal motion information is collapsed by synthesizing silhouette images of a user during the period of one meaningful gesture. In this paper, we first summarize the previous traditional approaches and neural network-based approaches for gesture recognition. Then we explain the data preprocessing procedure for making the motion history image and the neural network architecture with three convolution layers for recognizing the meaningful gestures. In the experiments, we trained five types of gestures, namely those for charging power, shooting left, shooting right, kicking left, and kicking right. The accuracy of gesture recognition was measured by adjusting the number of filters in each layer in the proposed network. We use a grayscale image with 240 × 320 resolution which defines one meaningful gesture and achieved a gesture recognition accuracy of 98.24%.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.04a
• /
• pp.901-903
• /
• 2014

논문에서는 비디오 감시 시스템을 기반으로 축사 내 환경 및 상황을 모니터링하고 최적의 번식 적기를 판별하기 위한 시스템을 제안한다. 본 논문에서 제안된 시스템은 영상 데이터로부터 각 프레임의 Motion History Image 처리를 이용하여 움직임 벡터를 추출하고 이를 유효한 움직임 벡터로 분류한다. 움직임 벡터의 크기와 방향이 임계값보다 큰 경우 해당 장면을 특정 상황으로 분류한다. 실제 촬영한 영상 데이터를 통해 실험한 결과, 승가 상황에서 확연한 결과값의 차이가 있었고, 이를 이용하여 한우의 승가 상황 검출이 가능함을 확인하였다.

• Journal of KIISE:Software and Applications
• /
• v.36 no.12
• /
• pp.977-985
• /
• 2009

This paper proposes a real-time algorithm for tracking the fast moving human body. Although Iterative closest point (ICP) algorithm is suitable for real-time tracking due to its efficiency and low computational complexity, ICP often fails to converge when the human body moves fast because the closest point may be mistakenly selected and trapped in a local minimum. To overcome such limitation, we combine a particle filter based on a motion history information with the ICP. The proposed human body motion tracking algorithm reduces the search space for each limb by employing a hierarchical tree structure, and enables tracking of the fast moving human bodies by using the motion prediction based on the motion history. Experimental results show that the proposed human body motion tracking provides accurate tracking performance and fast convergence rate.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.11
• /
• pp.2733-2737
• /
• 2014

Motion detection according to the movement and the change area detection method according to the background difference and the motion history image for use in a motion estimation technique using a real-time image, the motion detection method according to the optical flow, the back-projection of the histogram of the object to track for motion tracking At the heart of MeanShift center point of the object and the object to track, while used, the size, and the like due to the motion tracking algorithm CamShift, Kalman filter to track with direction. In this paper, we implemented the motion detection algorithm based on color and shape information of the object and verify.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.8
• /
• pp.3151-3168
• /
• 2015

Automatic detection of estrus in cows is important in cattle management. This paper proposes a method of estrus detection by automatically checking cattle mounting. We use a side-view video camera and apply computer vision techniques to detect mounting behavior. In particular, we extract motion information to select a potential mount-up and mount-down motion and then verify the true mounting behavior by considering the direction, magnitude, and history of the mount motion. From experimental results using video data obtained from a Korean native cattle farm, we believe that the proposed method based on the abrupt change of a mounting cow's height and motion history information can be utilized for detecting mounting behavior automatically, even in the case of fence occlusion.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.6 no.12
• /
• pp.3315-3337
• /
• 2012

Crowded scenes analysis is a challenging topic in computer vision field. How to detect diverse motion patterns in crowded scenarios from videos is the critical yet hard part of this problem. In this paper, we propose a novel approach to mining motion patterns by utilizing motion information during both long-term period and short interval simultaneously. To capture long-term motions effectively, we introduce Motion History Image (MHI) representation to access to the global perspective about the crowd motion. The combination of MHI and optical flow, which is used to get instant motion information, gives rise to discriminative spatial-temporal motion features. Benefitting from the robustness and efficiency of the novel motion representation, the following motion pattern mining is implemented in a completely unsupervised way. The motion vectors are clustered hierarchically through automatic hierarchical clustering algorithm building on the basis of graphic model. This method overcomes the instability of optical flow in dealing with time continuity in crowded scenes. The results of clustering reveal the situations of motion pattern distribution in current crowded videos. To validate the performance of the proposed approach, we conduct experimental evaluations on some challenging videos including vehicles and pedestrians. The reliable detection results demonstrate the effectiveness of our approach.

• Journal of the Korea Society of Computer and Information
• /
• v.16 no.4
• /
• pp.1-13
• /
• 2011

In this paper, we propose a gesture recognition system to recognize motions using the shape information of MHI (Motion History Image). The system acquires MHI to provide information on motions from images with input and extracts the gradient images from such MHI for each X and Y coordinate. It extracts the shape information by applying the shape context to each gradient image and uses the extracted pattern information values as the feature values. It recognizes motions by learning and classifying the obtained feature values with a SVM (Support Vector Machine) classifier. The suggested system is able to recognize the motions for multiple people as well as to recognize the direction of movements by using the shape information of MHI. In addition, it shows a high ratio of recognition with a simple method to extract features.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.4
• /
• pp.47-57
• /
• 2009

Event detection and recognition is an active and challenging topic recent in Computer Vision. This paper describes a new method for recognizing events caused by human motion from video sequences in an office environment. The proposed approach analyzes human motions using Motion History Image (MHI) sequences, and is invariant to body shapes. types or colors of clothes and positions of target objects. The proposed method has two advantages; one is thant the proposed method is less sensitive to illumination changes comparing with the method using color information of objects of interest, and the other is scale invariance comparing with the method using a prior knowledge like appearances or shapes of objects of interest. Combined with edge detection, geometrical characteristics of the human shape in the MHI sequences are considered as the features. An advantage of the proposed method is that the event detection framework is easy to extend by inserting the descriptions of events. In addition, the proposed method is the core technology for event detection systems based on context-aware computing as well as surveillance systems based on computer vision techniques.

• Journal of Korea Society of Industrial Information Systems
• /
• v.19 no.5
• /
• pp.9-14
• /
• 2014

Recently, various contents using human motion are developed in computer vision and game industries. If we try to apply human motion to application programs and contents, users can experience a sense of immersion getting into it so that the users feel a high level of satisfaction from the contents. In this research, we analyze human head motion using images captured from an webcam and then we apply the result of motion recognition to a game without special devices as an interface. The proposed method, first, segments human head region using an image composed of MHI(Motion History Image) and the result of skin color detection, and then we calculate the direction and distance by the MHI sequence. In experiments, the proposed method for human head motion recognition was tested for controlling a game player. From the experimental results we proved that the proposed method can make a gammer feel more immersed into the game. Furthermore, we expect the proposed method can be an interface of a serious game for medical or rehabilitation purposes.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.65 no.10
• /
• pp.1731-1737
• /
• 2016

In this paper, a method is proposed to recognize human actions as nonverbal expression; the proposed method is composed of two steps which are action representation and action recognition. First, MHI(Motion History Image) is used in the action representation step. This method includes segmentation based on depth information and generates spatio-temporal templates to describe actions. Second, CNN(Convolution Neural Network) which includes feature extraction and classification is employed in the action recognition step. It extracts convolution feature vectors and then uses a classifier to recognize actions. The recognition performance of the proposed method is demonstrated by comparing other action recognition methods in experimental results.