Real-time Stabilization Method for Video acquired by Unmanned Aerial Vehicle

무인 항공기 촬영 동영상을 위한 실시간 안정화 기법

  • Cho, Hyun-Tae (Department of Computer Science and Engineering, Konkuk University) ;
  • Bae, Hyo-Chul (Department of Computer Science and Engineering, Konkuk University) ;
  • Kim, Min-Uk (Department of Computer Science and Engineering, Konkuk University) ;
  • Yoon, Kyoungro (Department of Computer Science and Engineering, Konkuk University)
  • 조현태 (건국대학교 컴퓨터 공학부) ;
  • 배효철 (건국대학교 컴퓨터 공학부) ;
  • 김민욱 (건국대학교 컴퓨터 공학부) ;
  • 윤경로 (건국대학교 컴퓨터 공학부)
  • Received : 2014.02.12
  • Accepted : 2014.03.20
  • Published : 2014.03.31

Abstract

Video from unmanned aerial vehicle (UAV) is influenced by natural environments due to the light-weight UAV, specifically by winds. Thus UAV's shaking movements make the video shaking. Objective of this paper is making a stabilized video by removing shakiness of video acquired by UAV. Stabilizer estimates camera's motion from calculation of optical flow between two successive frames. Estimated camera's movements have intended movements as well as unintended movements of shaking. Unintended movements are eliminated by smoothing process. Experimental results showed that our proposed method performs almost as good as the other off-line based stabilizer. However estimation of camera's movements, i.e., calculation of optical flow, becomes a bottleneck to the real-time stabilization. To solve this problem, we make parallel stabilizer making average 30 frames per second of stabilized video. Our proposed method can be used for the video acquired by UAV and also for the shaking video from non-professional users. The proposed method can also be used in any other fields which require object tracking, or accurate image analysis/representation.

Keywords

References

  1. Kim, J.H., "Fast digital image stabilization based on edge detection", Korea University, Master Thesis, 2009.
  2. Chang, H.C., Lai, S.H., and K.R. Lu. "A robust realtime video stabilization algorithm", Journal on Visual Communications and Image Representation, 17(3):659- 673, 2006. https://doi.org/10.1016/j.jvcir.2005.10.004
  3. Shen, H., Pan, Q., Cheng, Y., and Yu, Y., "Fast Video Stabilization Algorithm for UAV", in proceeding of the IEEE International Conference on Intelligent Computing and Intelligent Systems, Vol. 4, pp. 542- 546, 2009.
  4. Gunnar Farneback, "Two-frame motion estimation based on polynomial expansion,"in Proc. of the 13th Scandinavian Conf. on Image Analysis, June-July 2003, vol. 2749 of LNCS, pp. 363-370.
  5. Savitsky, A., Golay, M.J.E., Smoothing and differentiation of dat a by simplified least squares procedures, Analytical Chemistry, 1964.
  6. vStab - KLT Video Stabilizer: http://vstab.sourceforge.net/
  7. deshaker: http://www.guthspot.se/video/deshaker.htm