Automatic Music Summarization Using Vector Quantization and Segment Similarity

  • Kim, Sang-Ho (The School of Engineering at Information and Communications University) ;
  • Kim, Sung-Tak (The School of Engineering at Information and Communications University) ;
  • Kim, Hoi-Rin (The School of Engineering at Information and Communications University)
  • Published : 2008.06.30

Abstract

In this paper, we propose an effective method for music summarization which automatically extracts a representative part of the music by using signal processing technology. Proposed method uses a vector quantization technique to extract several segments which can be regarded as the most important contents in the music. In general, there is a repetitive pattern in music, and human usually recognizes the most important or catchy tune from the repetitive pattern. Thus the repetition which is extracted using segment similarity is considered to express a music summary. The segments extracted are again combined to generate a complete music summary. Experiments show the proposed method captures the main theme of the music more effectively than conventional methods. The experimental results also show that the proposed method could be used for real-time application since the processing time in generating music summary is much faster than other methods.

Keywords

References

  1. International Federation of the Phonographic Industry (IFPI), 2005 Digital Music Report
  2. M. Cooper and J. Foote, Summarizing " popular music via structural similarity analysis," IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, October, 2003
  3. X. Shao, N. C. Maddage, C. Xu and M. S. Kankanhalli, "Automatic Music Summarization Based on Music Structure Analysis," In IEEE International Conf on Acoustics, Speech and Signal Processing (ICASSP05), Philadelphia, USA, 2005
  4. M. Cooper and J. Foote, "Automatic Music Summarization via Similarity Analysis, Proc. " IRCAM, 81-85, Oct. 2002
  5. J. Foote, "Visualizing Music and Audio using Self- Similarity," Proc. ACM Multimedia Conference, 77-80, Orlando, Florida, November 1999
  6. J. Foote, "Automatic Audio Segmentation using a Measure of Audio Novelty," In Proceedings of IEEE International Conference on Multimedia and Expo, I, 452-455
  7. B. Logan, and S. Chu,"Music summarization using key phrases," In Proc. IEEE ICASSP. 2000
  8. G. Peeters, A. L. Burthe and X. Rodet, "Toward Automatic Music Audio Summary Generation from Signal Analysis," Proc. ISMIR, Paris, 2002
  9. N. Maddage, X. Changsheng, M. Kankanhalli, and X. Shao. "Content -based music structure analysis with applications to music semantics understanding," In 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, October 2004
  10. L. Lu, M. Wang and H. J. Zhang, "Repeating Pattern Discovery and Structure Analysis from Acoustic Music Data," Workshop on Multimedia InformationRetrieval 2004, in conjuction with ACM Multimedia 2004, Oct 15-16,2004, New York, NY,2004
  11. W. Chai,"Semantic segmentation and summarization of music," IEEE signal processing magazine, March 2006
  12. Sangho Kim, Sungtak Kim, Suk-bong Kwon, and Hoirin Kim, "A Music summarization scheme using tempo tracking and two stage clustering," IEEE workshop on Multimedia Signal Processing 2006, Vol. 1, pp 225-228, Victoria, Canada, October 4, 2006