• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.7
• /
• pp.3599-3619
• /
• 2019

In human activity recognition system both static and motion information play crucial role for efficient and competitive results. Most of the existing methods are insufficient to extract video features and unable to investigate the level of contribution of both (Static and Motion) components. Our work highlights this problem and proposes Static-Motion fused features descriptor (SMFD), which intelligently leverages both static and motion features in the form of descriptor. First, static features are learned by two-stream 3D convolutional neural network. Second, trajectories are extracted by tracking key points and only those trajectories have been selected which are located in central region of the original video frame in order to to reduce irrelevant background trajectories as well computational complexity. Then, shape and motion descriptors are obtained along with key points by using SIFT flow. Next, cholesky transformation is introduced to fuse static and motion feature vectors to guarantee the equal contribution of all descriptors. Finally, Long Short-Term Memory (LSTM) network is utilized to discover long-term temporal dependencies and final prediction. To confirm the effectiveness of the proposed approach, extensive experiments have been conducted on three well-known datasets i.e. UCF101, HMDB51 and YouTube. Findings shows that the resulting recognition system is on par with state-of-the-art methods.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.29 no.5C
• /
• pp.683-691
• /
• 2004

To transmit MPEG-2 video on an errorneous channel, a number of error control techniques are needed. Especially, error concealment techniques which can be implemented on receivers independent of transmitters are essential to obtain good video quality. In this paper, prediction of motion vector and an adaptive boundary matching algorithm are presented for temporal error concealment. Before the complex BMA, we perform error concealment by a motion vector prediction using neighboring motion vectors. If the candidate of error concealment is not satisfied, search range and reliable boundary pixels are selected by the temporal activity or motion vectors and a damaged macroblock is concealed by applying an adaptive BMA. This error concealment technique reduces the complexity and maintains a PSNR gain of 0.3∼0.7㏈ compared to conventional BMA.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.2C
• /
• pp.166-174
• /
• 2006

In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Being based on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, stereo tracking of the target object can be possible. From some experiments with the 2 frames of the stereo image pairs having 256$\times$256 pixels, it is shown that the proposed stereo tracking system can adaptively track the target object with a low error ratio of about 3.05$\%$ on average between the detected and actual location coordinates of the target object.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.5C
• /
• pp.454-463
• /
• 2010

After the efficiency of H.264 video compression has been announced, it replaced MPEG-2 standard in several applications. So transcoding methods of MPEG-2 to H.264 have been studying because there are variety devices and contents followed by MPEG-2. Although H.264 supported various service such as IPTV, DMB, digital broadcasting etc, but users using MPEG-2 devices cannot accessible to them. This paper propose H.264 to MPEG-2 transcoding for users of MPEG-2 devices without displacement H.264. The proposed method predicted a motion vector for MPEG-2 encoder after it extracted from motion vectors of variable blocks in H.264 to improve processing time. Also it predicted a optimal motion vector using modified boundary matching algorithm after grasped a special character for boundary and background of object. The experimental results from proposed method show a considerable reduction in processing time, as much as 68% averagely, with a small objective quality reduction in PSNR.

• Journal of the Korea Computer Industry Society
• /
• v.4 no.12
• /
• pp.1075-1082
• /
• 2003

In this paper, we propose an Efficient Center-Biased Hybrid Seearch (ECBHS) for motion estimation based on Center-Biased Hybrid Search(CBHS). This proposed algorithm employ hybrid of a compact plus shaped search, X shaped search, and diamond search to reduce the search point for motion vectors which distributed within 3pels radius of center of search window. ECBHS reduces the computations for motion estimation of CBHS with similar accuracy The efficiency of the proposed algorithm was verified by experimental results.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.945-946
• /
• 2008

Feature matching is often used for image alignment. It, however, isconsidered as motion estimation problem in case of video. In that case we need only a motion vector in an image. Then we can compute the distance between two images although the images are far away each other. So we propose affine transformation from camera motion for spatial positioning of frames and aligning those frames. The data from this method can be useful for calculating the distance, stabilizing video, photographing panorama and so on.

• 전자공학회논문지 IE
• /
• v.43 no.2
• /
• pp.49-53
• /
• 2006

A fast motion-estimation algorithm based on regulated partial block distortions is proposed. The proposed algorithm can obtain very accurate motion vectors with a small computational load. Simulation results show that the proposed scheme provides very close performance to the full search while it is about 6 to 28 times faster than the full search.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.31B no.4
• /
• pp.62-76
• /
• 1994

In this paper, a segmentation-based coding technique as applied to video sequences is proposed. A proposed method separates an image into contour and texture parts, then the visually-sensitive contour part is represented by chain codes and the visually-insensitive texture part is reconstructed by a representative motion vector of a region and mean of the segmented frame difference. It uses a change detector to find moving areas and adopts variable blocks to represent different motions correctly. For better quality of reconstructed images, the displaced frame difference between the original image and the motion compensated image reconstructed by the representative motion vector is segmented. Computer simulation with several video sequences shows that the proposed method gives better performance than the conventional ones in terms of the peak signal to noise ratio(PSNR) and compression ration.

• Journal of Integrative Natural Science
• /
• v.12 no.1
• /
• pp.14-19
• /
• 2019

In this paper, we propose a system for controlling the brightness of street lights by predicting pedestrian paths, identifying the position of pedestrians with motion sensing sensors and obtaining motion vectors based on past walking directions, then predicting pedestrian paths through the route prediction smart street lighting system. In addition, by using motion vector data, the pre-treatment process using linear interpolation method and the fuzzy system and neural network system were designed in parallel structure to increase efficiency and the rough set was used to correct errors. It is expected that the system proposed in this paper will be effective in securing the safety of pedestrians and reducing light pollution and energy by predicting the path of pedestrians in the detection of movement of pedestrians and in conjunction with smart street lightings.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.12 no.1
• /
• pp.22-28
• /
• 2019

This paper presents a method for detection of an emergency signal expressed by arm gestures based on motion segmentation and face area detection in the surveillance system. The important indicators of emergency can be arm gestures and voice. We define an emergency signal as the 'Help Me' arm gestures in a rectangle around the face. The 'Help Me' arm gestures are detected by tracking changes in the direction of the horizontal motion vectors of left and right arms. The experimental results show that the proposed method successfully detects 'Help Me' emergency signal for a single person and distinguishes it from other similar arm gestures such as hand waving for 'Bye' and stretching. The proposed method can be used effectively in situations where people can't speak, and there is a language or voice disability.