• Title/Summary/Keyword: Global motion estimation

Search Result 76, Processing Time 0.023 seconds

A Study about Implementation of Object Tracking on FPGA (물체추적을 위한 FPGA 구현에 대한 연구)

  • Yang, Chan-Woo;Kim, Dong-Hun;Shin, Yun-Soo;Ko, Kwang-Cheol
    • Proceedings of the KIEE Conference
    • /
    • 2002.11c
    • /
    • pp.525-528
    • /
    • 2002
  • This study describes an implementation of object tracking algorithm on FPGA. The global system detect the zone there is more motion in, attending to the generated optical flow, and centers its attention to it to improve the details In this case, To obtain image in Camera, Image aquisition board make use of SAA7113 Video Input processor and algorithm is applied to motion estimation and difference picture. Also, This work can be applied kalman filter to reliability of tracking.

  • PDF

Object-Based Video Segmentation Using Spatio-temporal Entropic Thresholding and Camera Panning Compensation (시공간 엔트로피 임계법과 카메라 패닝 보상을 이용한 객체 기반 동영상 분할)

  • 백경환;곽노윤
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.4 no.3
    • /
    • pp.126-133
    • /
    • 2003
  • This paper is related to a morphological segmentation method for extracting the moving object in video sequence using global motion compensation and two-dimensional spatio-temporal entropic thresholding. First, global motion compensation is performed with camera panning vector estimated in the hierarchical pyramid structure constructed by wavelet transform. Secondly, the regions with high possibility to include the moving object between two consecutive frames are extracted block by block from the global motion compensated image using two-dimensional spatio-temporal entropic thresholding. Afterwards, the LUT classifying each block into one among changed block, uncertain block, stationary block according to the results classified by two-dimensional spatio-temporal entropic thresholding is made out. Next, by adaptively selecting the initial search layer and the search range referring to the LUT, the proposed HBMA can effectively carry out fast motion estimation and extract object-included region in the hierarchical pyramid structure. Finally, after we define the thresholded gradient image in the object-included region, and apply the morphological segmentation method to the object-included region pixel by pixel and extract the moving object included in video sequence. As shown in the results of computer simulation, the proposed method provides relatively good segmentation results for moving object and specially comes up with reasonable segmentation results in the edge areas with lower contrast.

  • PDF

Robust Estimation of Camera Motion Using A Local Phase Based Affine Model (국소적 위상기반 어파인 모델을 이용한 강인한 카메라 움직임 추정)

  • Jang, Suk-Yoon;Yoon, Chang-Yong;Park, Mig-Non
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.46 no.1
    • /
    • pp.128-135
    • /
    • 2009
  • Techniques for tracking the same region of physical space with the temporal sequences of images by matching the contours of constant phase show robust and stable performance in relative to the tracking techniques using or assuming the constant intensity. Using this property, we describe an algorithm for obtaining the robust motion parameters caused by the global camera motion. First, we obtain the optical flow based on the phase of spacially filtered sequential images on the region in a direction orthogonal to orientation of each component of gabor filter bank. And then, we apply the least squares method to the optical flow to determine the affine motion parameters. We demonstrate hat proposed method can be applied to the vision based pointing device which estimate its motion using the image including the display device which cause lighting condition varieties and noise.

Silhouette-based motion recognition for young children using an RBF network (RBF 신경망을 이용한 실루엣 기반 유아 동작 인식)

  • Kim, Hye-Jeong;Lee, Kyoung-Mi
    • Journal of Internet Computing and Services
    • /
    • v.8 no.3
    • /
    • pp.119-129
    • /
    • 2007
  • To recognition a human motion, in this paper, we propose a neural approach using silhouettes in video frames captured by two cameras placed at the front and side of the human body. To extract features of the silhouettes for motion estimation, the proposed system computes both global and local features and then groups these features into static and dynamic features depending on whether features are in a static frame. Extracted features are in a static frame. Extracted features are used to train a RBF network. The neural system uses static features as the input of the neural network and dynamic features as additional features for recognition. In this paper, the proposed method was applied to movement education for young children. The basic movements for such education consist of locomotor movements, such as walking, jumping, and hopping, and non-locomotor movements, including bending, stretching, balancing and turning. The system demonstrated the effectiveness of motion recognition for movement education generated by the proposed neural network. The proposed system dan be extended to the system for movement education which develops the spatial sense of young children.

  • PDF

INS/GPS Integrated Smoothing Algorithm for Synthetic Aperture Radar Motion Compensation Using an Extended Kalman Filter with a Position Damping Loop

  • Song, Jin Woo;Park, Chan Gook
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.18 no.1
    • /
    • pp.118-128
    • /
    • 2017
  • In this study, we propose a real time inertial navigation system/global positioning system (INS/GPS) integrated smoothing algorithm based on an extended Kalman filter (EKF) and a position damping loop (PDL) for synthetic aperture radar (SAR). Integrated navigation algorithms usually induce discontinuities due to error correction update by the Kalman filter, which are as detrimental to the performance of SAR as the relative position error. The proposed smoothing algorithm suppresses these discontinuities and also reduces the relative position error in real time. An EKF estimates the navigation errors and sensor biases, and all the errors except for the position error are corrected directly and instantly. A PDL activated during SAR operation period imposes damping effects on the position error estimates, where the estimated position error is corrected smoothly and gradually, which contributes to the real time smoothing and small relative position errors. The residual errors are re-estimated by the EKF to maintain the estimation performance and the stability of the overall loop. The performance improvements were confirmed by Monte Carlo simulations. The simulation results showed that the discontinuities were reduced by 99.8% and the relative position error by 48% compared with a conventional EKF without a smoothing loop, thereby satisfying the basic performance requirements for SAR operation. The proposed algorithm may be applicable to low cost SAR systems which use a conventional INS/GPS without changing their hardware configurations.

Image Stabilization Algorithm for Close Watching UAV(Unmanned Aerial Vehicle) Aystem (근접감시용 무인항공기 시스템을 위한 영상 안정화 알고리즘)

  • Lee, Hong-Suk;Lee, Tae-Yeoung;Kim, Byoung-Soo;Ko, Yun-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.47 no.6
    • /
    • pp.10-18
    • /
    • 2010
  • This paper proposes an image stabilization algorithm for close watching UAV(Unmanned Aerial Vehicle) using motion separation and stabilization mode. The motion of UAV is composed of its actual navigating motion and unwanted vibrating motion so that image sequences obtained from UAV are shaken randomly. In order to stabilize these images we separate the vibrating motion component from UAV motion and remove the effect caused by it from image sequences. In the proposed algorithm the motion and global intensity change of two consecutive images are modeled with 6 motion parameters and 2 intensity change parameters respectively. These modeled parameters are estimated by non-linear least square method based on Gauss-Newton algorithm. The vibrating motion component is separated from the estimated motion using IIR filtering and the geometric deformation caused by it is removed from image sequences. In order to apply the proposed method to real aerial image sequences with many abrupt changes of camera view, we proposed a stabilizing method using two different modes named as stabilizing and non-stabilizing mode. Experimental results show that the accuracy of motion estimation is 99% and the efficiency of removing the vibrating motion component is 90%. We apply the proposed method to real aerial image sequences and verified its stabilizing performance.

Lightweight Attention-Guided Network with Frequency Domain Reconstruction for High Dynamic Range Image Fusion

  • Park, Jae Hyun;Lee, Keuntek;Cho, Nam Ik
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2022.06a
    • /
    • pp.205-208
    • /
    • 2022
  • Multi-exposure high dynamic range (HDR) image reconstruction, the task of reconstructing an HDR image from multiple low dynamic range (LDR) images in a dynamic scene, often produces ghosting artifacts caused by camera motion and moving objects and also cannot deal with washed-out regions due to over or under-exposures. While there has been many deep-learning-based methods with motion estimation to alleviate these problems, they still have limitations for severely moving scenes. They also require large parameter counts, especially in the case of state-of-the-art methods that employ attention modules. To address these issues, we propose a frequency domain approach based on the idea that the transform domain coefficients inherently involve the global information from whole image pixels to cope with large motions. Specifically we adopt Residual Fast Fourier Transform (RFFT) blocks, which allows for global interactions of pixels. Moreover, we also employ Depthwise Overparametrized convolution (DO-conv) blocks, a convolution in which each input channel is convolved with its own 2D kernel, for faster convergence and performance gains. We call this LFFNet (Lightweight Frequency Fusion Network), and experiments on the benchmarks show reduced ghosting artifacts and improved performance up to 0.6dB tonemapped PSNR compared to recent state-of-the-art methods. Our architecture also requires fewer parameters and converges faster in training.

  • PDF

Surf points based Moving Target Detection and Long-term Tracking in Aerial Videos

  • Zhu, Juan-juan;Sun, Wei;Guo, Bao-long;Li, Cheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.11
    • /
    • pp.5624-5638
    • /
    • 2016
  • A novel method based on Surf points is proposed to detect and lock-track single ground target in aerial videos. Videos captured by moving cameras contain complex motions, which bring difficulty in moving object detection. Our approach contains three parts: moving target template detection, search area estimation and target tracking. Global motion estimation and compensation are first made by grids-sampling Surf points selecting and matching. And then, the single ground target is detected by joint spatial-temporal information processing. The temporal process is made by calculating difference between compensated reference and current image and the spatial process is implementing morphological operations and adaptive binarization. The second part improves KALMAN filter with surf points scale information to predict target position and search area adaptively. Lastly, the local Surf points of target template are matched in this search region to realize target tracking. The long-term tracking is updated following target scaling, occlusion and large deformation. Experimental results show that the algorithm can correctly detect small moving target in dynamic scenes with complex motions. It is robust to vehicle dithering and target scale changing, rotation, especially partial occlusion or temporal complete occlusion. Comparing with traditional algorithms, our method enables real time operation, processing $520{\times}390$ frames at around 15fps.

A Non-uniform Correction Algorithm Based on Scene Nonlinear Filtering Residual Estimation

  • Hongfei Song;Kehang Zhang;Wen Tan;Fei Guo;Xinren Zhang;Wenxiao Cao
    • Current Optics and Photonics
    • /
    • v.7 no.4
    • /
    • pp.408-418
    • /
    • 2023
  • Due to the technological limitations of infrared thermography, infrared focal plane array (IFPA) imaging exhibits stripe non-uniformity, which is typically fixed pattern noise that changes over time and temperature on top of existing non-uniformities. This paper proposes a stripe non-uniformity correction algorithm based on scene-adaptive nonlinear filtering. The algorithm first uses a nonlinear filter to remove single-column non-uniformities and calculates the actual residual with respect to the original image. Then, the current residual is obtained by using the predicted residual from the previous frame and the actual residual. Finally, we adaptively calculate the gain and bias coefficients according to global motion parameters to reduce artifacts. Experimental results show that the proposed algorithm protects image edges to a certain extent, converges fast, has high quality, and effectively removes column stripes and non-uniform random noise compared to other adaptive correction algorithms.

Development of a Short-term Rainfall Forecasting Model Using Weather Radar Data (기상레이더 자료를 이용한 단시간 강우예측모형 개발)

  • Kim, Gwang-Seob; Kim, Jong-Pil
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.10
    • /
    • pp.1023-1034
    • /
    • 2008
  • The size and frequency of the natural disaster related to the severe storms are increased for recent decades in all over the globe. The damage from natural disasters such as typhoon, storm and local severe rainfall is very serious in Korea since they are concentrated on summer season. These phenomena will be more frequent in the future because of the impact of climate change related to increment of $CO_2$ concentration and the global warming. To reduce the damage from severe storms, a short-range precipitation forecasting model using a weather radar was developed. The study was conducted as following four tasks: conversion three-dimensional radar data to two-dimensional CAPPI(Constant Altitude Plan Position Indicator) efficiently, prediction of motion direction and velocity of a weather system, estimation of two-dimensional rainfall using operational calibration. Results demonstrated that two-dimensional estimation using weather radar is useful to analyze the spatial characteristics of local storms. If the precipitation forecasting system is linked to the flood prediction system, it should contribute the flood management and the mitigation of flood damages.