KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Antiblurry Dejitter Image Stabilization Method of Fuzzy Video for Driving Recorders

  • Xiong, Jing-Ying (Key Laboratory of Airborne Optical Imaging and Measurement, Changchun Institute of Optics, Fine Mechanics and Physics Chinese Academy of Sciences) ;
  • Dai, Ming (Key Laboratory of Airborne Optical Imaging and Measurement, Changchun Institute of Optics, Fine Mechanics and Physics Chinese Academy of Sciences) ;
  • Zhao, Chun-Lei (Key Laboratory of Airborne Optical Imaging and Measurement, Changchun Institute of Optics, Fine Mechanics and Physics Chinese Academy of Sciences) ;
  • Wang, Ruo-Qiu (University of Chinese Academy of Sciences)
  • Received : 2016.12.14
  • Accepted : 2017.03.20
  • Published : 2017.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Video images captured by vehicle cameras often contain blurry or dithering frames due to inadvertent motion from bumps in the road or by insufficient illumination during the morning or evening, which greatly reduces the perception of objects expression and recognition from the records. Therefore, a real-time electronic stabilization method to correct fuzzy video from driving recorders has been proposed. In the first stage of feature detection, a coarse-to-fine inspection policy and a scale nonlinear diffusion filter are proposed to provide more accurate keypoints. Second, a new antiblurry binary descriptor and a feature point selection strategy for unintentional estimation are proposed, which brought more discriminative power. In addition, a new evaluation criterion for affine region detectors is presented based on the percentage interval of repeatability. The experiments show that the proposed method exhibits improvement in detecting blurry corner points. Moreover, it improves the performance of the algorithm and guarantees high processing speed at the same time.

Keywords

References

  1. K. Uomon, A. Morimura, H. lshii, T. Sakaguchi, and Y. Kitamura, "Automatic image stabilizing system by fully-digital signal processing," IEEE Trans. on Consumer Electronics, vol. 36, no. 3, Aug, 1990.
  2. T. Kinugasa, N. Yamamoto, and l. Komatsu, "Electronic image stabilizer for video camera use," IEEE Trans. on Consumer Electronics, vol. 36, no. 3, Aug, 1990.
  3. J.-J. Zhu and B-l. Guo, "Electronic image stabilization algorithm based on adaptive motion filter," Journal of Theoretical and Applied Information Technology, vol. 50, no. 1, Apr. 2013.
  4. O. Urhan and S. Erturk, " Single sub-image matching based low complexity motion estimation for digital image stabilization using constrained one-bit transform," IEEE Trans. on Consumer Electronics, vol. 52, no. 4, pp. 1275-1279, Nov, 2006. https://doi.org/10.1109/TCE.2006.273145
  5. H. Okuda, M. Hashimoto, K. Sumi, and S. Kaneko, "Optimum motion estimation algorithms for fast and robust digital image stabilization," IEEE Trans. on Consumer Electronics, vol. 51, no. 1, pp. 276-280, Feb, 2006.
  6. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. of the seventh IEEE International Conference on Computer Vision, 1150-1157, 1999.
  7. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. of International Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 506-513, Jun, 2004.
  8. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 10, 27, pp 1615-1630, 2005.
  9. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," Computer Vision-ECCV, 404-417, 2006.
  10. M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "BRIEF: Binary robust independent elementary features," Computer Vision-ECCV 2010, pp. 778-792, 2010.
  11. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. of 2011 International Conference on Computer Vision, 2011.
  12. S. Leutenegger, M. Chli, R. Siegwart, "BRISK: Binary robust invariant scalable keypoints," in Proc. of 2011 International Conference on Computer Vision, 2011.
  13. P. F. Alcantarilla, A. Bartoli, A. J. Davison, "KAZE Features," in Proc. of the European Conference on Computer Vision, 2012.
  14. K. Mikolajczyk, T Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool, "A comparison of affine region detectors," in Proc. of the International Journal of Computer Vision, 2005.
  15. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Proc. of European Conference on Computer Vision, 2006.
  16. J. Shi and C. Tomasi, "Good features to track," in Proc. of 9th IEEE Conference on Computer Vision and Pattern Recognition, Springer, June, 1994.
  17. H. Moravec, "Obstacle Avoidance and Navigation in the Real World by a Seeing Robot Rover," Tech Report CMU-RI-TR-3 Carnegie-Mellon University, Robotics Institute, 1980.
  18. C. Harris and M. Stephens, "A combined comer and edge detector," in Proc. of the 4th Alvey Vision Conference, 1988.
  19. T. Lindeberg, "Image matching using generalized scale-space interest points," Journal of Mathematical Imaging and Vision, 2015.
  20. A. Neubeck, L. Van Gool, "Efficient non-maximum suppression," in Proc. of International Conference on Pattern Recognition (ICPR), 2006.
  21. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Communication ACM, 24(6): 381-395, 1981. https://doi.org/10.1145/358669.358692
  22. S. Yao, G. Parthasarathy, and D. Thyagaraju, "Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework," IEEE Trans. Consumer Electronics, vol. 55, no. 3, pp. 1714-1721, Aug, 2009. https://doi.org/10.1109/TCE.2009.5278047
  23. S. B. Balakirsky, R. Chellappa. "Performance characterization of image stabilization algorithms," in Proc. of 3rd IEEE International Conference on Image Processing, 1996.