Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Rough Set-Based Approach for Automatic Emotion Classification of Music

  • Baniya, Babu Kaji (Dept. of Computer Science and Engineering, Chonbuk National University) ;
  • Lee, Joonwhoan (Dept. of Computer Science and Engineering, Chonbuk National University)
  • Received : 2015.08.24
  • Accepted : 2016.07.05
  • Published : 2017.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Music emotion is an important component in the field of music information retrieval and computational musicology. This paper proposes an approach for automatic emotion classification, based on rough set (RS) theory. In the proposed approach, four different sets of music features are extracted, representing dynamics, rhythm, spectral, and harmony. From the features, five different statistical parameters are considered as attributes, including up to the $4^{th}$ order central moments of each feature, and covariance components of mutual ones. The large number of attributes is controlled by RS-based approach, in which superfluous features are removed, to obtain indispensable ones. In addition, RS-based approach makes it possible to visualize which attributes play a significant role in the generated rules, and also determine the strength of each rule for classification. The experiments have been performed to find out which audio features and which of the different statistical parameters derived from them are important for emotion classification. Also, the resulting indispensable attributes and the usefulness of covariance components have been discussed. The overall classification accuracy with all statistical parameters has recorded comparatively better than currently existing methods on a pair of datasets.

Keywords

References

  1. Y. H. Yang, Y. C. Lin, Y. F. Su, and H. H. Chen, "A regression approach to music emotion recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 16, no. 2, pp. 448-457, 2008. https://doi.org/10.1109/TASL.2007.911513
  2. D. Cabrera, "PsySound: a computer program for psychoacoustical analysis," in Proceedings of the Australian Acoustical Society Conference, Melbourne, 1999, pp. 47-54.
  3. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Transactions on Speech and Audio Processing, vol. 10, no. 5, pp. 293-302, 2002. https://doi.org/10.1109/TSA.2002.800560
  4. L. Lu, D. Liu, and H. J. Zhang, "Automatic mood detection and tracking of music audio signals," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 1, pp. 5-18, 2006. https://doi.org/10.1109/TSA.2005.860344
  5. T. Li and M. Ogihara, "Content-based music similarity search and emotion detection," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'04), Toulouse, France, 2004, pp. 705-708.
  6. A. Sen and M. Srivastava, Regression Analysis: Theory, Methods, and Applications. New York: Springer, 1990.
  7. A. J. Smola and B. Scholkopf, "A tutorial on support vector regression," Statistics and Computing, vol. 14, no. 3, pp. 199-222, 2004. https://doi.org/10.1023/B:STCO.0000035301.49549.88
  8. Y. H. Yang and H. H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 762-774, 2011. https://doi.org/10.1109/TASL.2010.2064164
  9. D. P. Solomatine and D. L. Shrestha, "AdaBoost.RT: a boosting algorithm for regression problems," in Proceedings of IEEE International Joint Conference on Neural Networks, Budapest, Hungary, 2004, pp. 1163- 1168.
  10. O. Lartillot and P. Toivianen, "MIR in MATLAB (II): a toolbox for musical feature extraction from audio," in Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR2007), Vienna, Austria, 2007, pp. 127-130.
  11. E. Pampalk, "A MATLAB toolbox to compute music similarity from audio," in Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR2004), Barcelona, Spain, 2004, pp. 1-4.
  12. F. Pachet and P. Roy, "Improving multilabel analysis of music titles: a large-scale validation of the correction approach," IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 2, pp. 335-343, 2009. https://doi.org/10.1109/TASL.2008.2008734
  13. R. Panda, R. Malheiro, B. Rocha, A. Oliveira, and R. P. Paiva, "Multi-modal music emotion recognition: a new dataset, methodology and comparative analysis," in Proceedings of 10th International Symposium on Computer Music Multidisciplinary Research (CMMR'2013), Marseille, France, 2013, pp. 1-13.
  14. B. K. Baniya, D. Ghimire, and J. Lee, "Evaluation of different audio features for musical genre classification" in Proceedings of IEEE Workshop on Signal Processing Systems (SiPS), Taipei, Taiwan, 2013, pp. 260-265.
  15. B. K. Baniya, J. Lee, and Z. N. Li, "Audio feature reduction and analysis for automatic music genre classification," in Proceedings of 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), San Diego, CA, 2004, pp. 457-462.
  16. B. K. Baniya, D. Ghimire, and J. Lee, "Automatic music genre classification using timbral texture and rhythmic content features," in Proceedings of 17th International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea, 2015, pp. 434-443.
  17. B. K. Baniya and C. S. Hong, "Music mood classification using reduced audio features," in Proceedings of Korea Computer Congress (KCC), Jeju, Korea, 2015, pp. 915-917.
  18. ROSE2 (Rough Sets Data Explorer) [Online]. Available: http://idss.cs.put.poznan.pl/site/rose.html.
  19. Soundtracks datasets for music and emotion [Online]. Available: www.jyu.fi/music/coe/materials/emotion/soundtracks.
  20. MOODetector [Online]. Available: http://mir.dei.uc.pt/downloads.html.
  21. P. Saari, T. Eerola, and O. Lartillot, "Generalizability and simplicity as criteria in feature selection: application to mood classification in music," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 6, pp. 1802-1812, 2011. https://doi.org/10.1109/TASL.2010.2101596
  22. J. A. Russell, A. Weiss, and G. A. Mendelsohn, "Affect grid: a single-item scale of pleasure and arousal," Journal of Personality and Social Psychology, vol. 57, no. 3, pp. 493-502, 1989. https://doi.org/10.1037/0022-3514.57.3.493
  23. H. S. Nguyen, "Discretization of real value attributes: a Boolean reasoning approach," Ph.D. dissertation, Department of Mathematics, Warsaw University, Warsaw, Poland, 1997.
  24. A. Papoulis and S. Unnikrishna Pillai, Probability, Random Variables, and Stochastic Processes. Boston, MA: McGraw-Hill, 2002.
  25. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data. Dordrecht: Kluwer Academic Publisher, 1991.
  26. S. Dalai, B. Chatterjee, D. Dey, S. Chakravorti, and K. Bhattacharya, "Rough-set-based feature selection and classification for power quality sensing device employing correlation techniques," IEEE Sensors Journal, vol. 13, no. 2, pp. 563-573, 2013. https://doi.org/10.1109/JSEN.2012.2219144
  27. Z. Pawlak, "Rough set theory and its applications," Journal of Telecommunications and Information Technology, vol. 9, no. 3, pp. 7-10, 2002.

Cited by

  1. Comparative analysis of affective and physiological responses to emotional movies vol.8, pp.1, 2018, https://doi.org/10.1186/s13673-018-0138-5