Journal of the Institute of Convergence Signal Processing (융합신호처리학회논문지)

The Korea Institute of Convergence Signal Processing (한국융합신호처리학회)
권호 표지

Video Stabilization using Phase Correlation and Kalman Filter-Based Motion Prediction

위상상관과 칼만 필터 움직임 예측을 이용한 동영상 안정화

  • Published : 2009.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Real-time video stabilization technology is used in correction for the camera vibrations of the hand-held camera by hand or fixed camera by external condition. This paper is about the counterplan to cope with the vibration of the movie generated by the large external cause relatively. we use the movie stabilization parameters with the phase correlation method based the DFT to get the displacements of the current frame to the reference frame. we use the kalman filter for the efficient and stable searching works on the phase correlation map and present the proper conditions for the real-time processing through the experiments. We propose the measure to evaluate the capability of the video stabilizer which is the standard deviation of the brightness of the center block. and compare the capability for the video sequences randomly shifted and the jittered video sequences obtained from camera.

실시간 영상 안정화 기술은 손떨림에 의한 휴대용 카메라 혹은 외부적 조건에 의한 고정 카메라의 흔들림 보상에 이용된다. 본 논문은 비교적 큰 외부적 요인으로 인하여 발생하는 동영상의 흔들림에 대한 대책에 관한 것이다. 동영상 안정화 파라메터로 이용되는 기준 프레임에 대한 현재 프레임의 변위를 얻기 위하여 DFT에 기반한 위상 상관법을 이용한다. 그리고 위상 상관지도에서의 효율적이고 안정적인 탐색을 위하여 칼만 필터를 이용하여 탐색 범위를 추정하는 방법과 안정적인 성능과 실시간 처리에 필요한 조건을 실험적으로 찾아내고 그 조건을 제시한다. 중심 지점에 대한 평균밝기의 표준편차 값을 동영상 안정화의 성능 평가 척도로 제안하고 가상 흔들림 동영상과 실제 흔들림 동영상에 대하여 성능을 서로 비교하였다.

Keywords

References

  1. O-hyun Kwon, Jeong-ho Shin, Joon-ki Paik "Video Stabilization Using Kalman Filter and Phase Correlation Matching" LNCS3656, 09, pp.141-148. 2005.
  2. T. Chen. Video Stabilization Using a Block-Based Parametric Motion Model. Technical report, Stanford University, Information Systems Laboratory, Dept. of Electrical Engineering, Winter 2000.
  3. J. Chang, W. Hu, M. Cheng, and B. Chang. Digital image translational and rotational motion stabilization using optical flow technique. IEEE Transactions on Consumer Electronics, vol. 48, no. 1, pp. 108-115, Feb. 2002. https://doi.org/10.1109/TCE.2002.1010098
  4. C. Erdem and A. Erdem. An illumination invariant algorithm for subpixel accuracy image stabilization and its effect on MPEG-2 video compression. Elsevier Signal Processing: Image Communication, vol. 16, pp. 837-857, 2001. https://doi.org/10.1016/S0923-5965(00)00046-1
  5. S. Ko, S. Lee, S. Jeon, and E. Kang. Fast digital image stabilizer based on gray-coded bit-plane matching. IEEE Transactions on Consumer Electronics, vol. 45, no. 3, pp. 598-603, Aug. 1999. https://doi.org/10.1109/30.793546
  6. M. Ben-Ezra, S. Peleg, and M. Werman. A Real-Time Video Stabilizer Based on Linear Programming.
  7. A. Censi, A. Fusiello, and V. Roberto. Image Stabilization by Features Tracking. Technical report, University of Udine, Machine Vision Laboratory, Dept. of Mathematics and Informatics, 1998.
  8. J. Jin, Z. Zhu, and G. Xu. Digital Video Sequence Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering. Real-Time Imaging, vol. 7, pp. 357-365, 2001. https://doi.org/10.1006/rtim.2000.0243
  9. J. Jin, Z. Zhu, and G. Xu. A Stable Vision System for Moving Vehicles. IEEE Transactions on Intelligent Transportation Systems, vol. 1, no. 1, pp. 32-39, Mar. 2000. https://doi.org/10.1109/6979.869019
  10. Sung-Jae Ko, Sung-Hee Lee, Seung-Won Jeon, Eui-Sung Kang, "Fast Digital Image Stabilization Based On Gray-Coded Bit-Plane Matching" IEEE Tans. On Consumer Electronics, Vol. 45, No. 3, August. pp. 598-603. 1999. https://doi.org/10.1109/30.793546
  11. Wen-Chung Kao, Lien-Yang Chen, Shou-Hung Chen, "Real-Time Image Stabilization for Digital Video Cameras" Proceedings of 2006 CACS Automatic Control Conference St. John's Univ, Tamsui, Taiwan, Nov. pp.10-11, 2006.
  12. Fedwa Essannouni et al. "An efficient fast full search block matching algorithm using FFT algorithms" IJCSNS International Journal of Computer Science and Network Security, VOL.6 No.3B, March 2006.
  13. Zhigang Zhu et al. "Camera Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering" IEEE International Conference on Intelligent Vehicles 19998.
  14. S. Erturk. "Digital Image Stabilization with Sub-Image Phase Correlation Based Global Motion Estimation" IEEE Transactions on Consumer Electronics Vol. 49, No. 4, NOVEMBER 2003.
  15. E. De Castro and C. Morandi "Registration of Translated and Rotated Images Using Finite Fourier Transforms, IEEE Transactions on pattern analysis and machine intelligence, Sept. 1987.
  16. 한학용, 강봉순, “위상상관을 이용한 동영상 안정화 성능비교,” 2008 한국정보기술학회 하계학술대회 논문집 pp. 11-14, 2007.