Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Key Frame Extraction using Shot Coverage and Distortion

샷 기여도와 왜곡률을 고려한 키 프레임 추출 알고리즘

  • Published : 2003.05.01
Download PDF
⟨ Previous Next ⟩

Abstract

Key frame extraction has been recognized as one of tile important research issues in video information retrieval. Although progress has been made in key frame extraction, the existing approaches do not evaluate the importance of extracted frame Quantitatively, and Dey are computationally expensive or ineffective. In this Paper, we introduce a new 미해rithm for key frame extraction using shot coverage and distortion. The algorithm finds significant key frames from candidate key frames. When selecting the candidate frames, the coverage rate to the total frames from each frame is computed by using the difference between the adjacent frames in tile shot. The frames within 10$\%$ from the top are selected as the candidates. Then, by comfuting the distortion rate of the candidates against all frames, pick the frames which arc most representative are selected. The performance of the proposed algorithm has been verified by a statistical test. Experiments show that more than 13-50$\%$ improvement has been obtained by the proposed algorithm compared to the existing methods.

Keywords

References

  1. F. Idris and S. Panchanathan, 'Review of Image and Video Indexing Techniques', Journal of Visual Communication and Image Representation, Vol. 8, No. 2, June, pp. 146-166, 1997 https://doi.org/10.1006/jvci.1997.0355
  2. Y. Zhuang, Y. Rui, T.S. Huang, S. Mehrotra, 'Adaptive Key Frame Extraction Using Unsupervised Clustering,' Proc. of lnt. Conf. on Image Proc., Chicago, Oct, 1998 https://doi.org/10.1109/ICIP.1998.723655
  3. P.O. Gresle and T.S. Huang, 'Gisting of Video Documents : A Key Frames Selection Algorithm using Relative Acitivity Measure,' Proc. The 2nd Int. Conf. on Visual Information Systems, 1997
  4. R. Brunelli, O. Mich, and C.Modena, 'A Survey of the Automatic Indexing of Video Date', Journal of Visual Communication and Image Representation, Vol.10, pp. 78-112,1999 https://doi.org/10.1006/jvci.1997.0404
  5. X. Ju, J. Black, 'Summarization of Videotaped Presentations : Automatic Analysis of Motion and Gesture' IEEE Trans. on Circuits and Systems for Video Technology, Vol. 8, No. 5, September 1998 https://doi.org/10.1109/76.718513
  6. A. Nagasaka and Y. Tanaka, 'Automatic Video Indexing and Full-Video Search for Object Appearances,' Visual Database Systems II, 1992
  7. Hong Jiang Zhang, Jianhua Wu, Di Zhong and Stephen W, Smoliar, 'An Integrated System for Content-based Video Tetrieval and Browsing', Pattern Recognition, Vol. 30, No.4, pp. 643-658, 1997 https://doi.org/10.1016/S0031-3203(96)00109-4
  8. W. Wolf, 'Key Frame Selection by Motion Analysis,' Proc. IEEE Int. Conf. Acoust., Speech, and Signal Proc., 1996 https://doi.org/10.1109/ICASSP.1996.543588
  9. F. Dufaux, 'Key Frame Selection to Represent Video' Proc. International Conference Image Processing, pp. 275~278, June 2000 https://doi.org/10.1109/ICIP.2000.899354
  10. K.J. Han and A.H. Tewfik, 'Eigen Image Based Video Segmentation and Indexing,' Proc. International Conference Image Processing, 1997 https://doi.org/10.1109/ICIP.1997.638827
  11. T. Vlachos, 'Cut Detection in Video Sequences Using Phase Correlation,' IEEE Signal Processing Letters, Vol. 7, No. 7, July 2000 https://doi.org/10.1109/97.847360