Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Lightweight and Effective Music Score Recognition on Mobile Phones

  • Nguyen, Tam (Saigon Technology University) ;
  • Lee, Gueesang (Dept. of Electrical and Computer Engineering, Chonnam National University)
  • Received : 2014.02.20
  • Accepted : 2015.03.24
  • Published : 2015.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Recognition systems for scanned or printed music scores that have been implemented on personal computers have received attention from numerous scientists and have achieved significant results over many years. A modern trend with music scores being captured and played directly on mobile devices has become more interesting to researchers. The limitation of resources and the effects of illumination, distortion, and inclination on input images are still challenges to these recognition systems. In this paper, we introduce a novel approach for recognizing music scores captured by mobile cameras. To reduce the complexity, as well as the computational time of the system, we grouped all of the symbols extracted from music scores into ten main classes. We then applied each major class to SVM to classify the musical symbols separately. The experimental results showed that our proposed method could be applied to real time applications and that its performance is competitive with other methods.

Keywords

References

  1. G. S. Choudhury, M. Droetboom, T. DiLauro, I. Fujinaga, and B. Harrington, "Optical music recognition system within a large-scale digitization project," in Proceedings of 1st International Symposium on Music Information Retrieval (ISMIR 2000), Plymouth, MA, 2000.
  2. M. Droettboom, I. Fujinaga, and K. MacMillan, "Optical music interpretation," in Structural, Syntactic, and Statistical Pattern Recognition. Heidelberg: Springer, 2002, pp. 378-387.
  3. S. E. George, Visual Perception of Music Notation: On-Line and Off-Line Recognition. Hershey, PA: IRM Press, 2005.
  4. W. Homcnda and M. Luckner, "Automatic knowledge acquisition: recognizing music notation with methods of centroids and classifications trees," in Proceedings of International Joint Conference on Neural Networks (IJCNN'06), Vancouver, Canada, 2006, pp. 3382-3388.
  5. L. J. Tardon, S. Sammartino, I. Barbancho, V. Gomez, and A. Oliver, "Optical music recognition for scores written in white mensural notation," Journal on Image and Video Processing, vol. 2009, article no. 6, 2009.
  6. G. Taubman, "Musichand: a handwritten music recognition system," thesis, Brown University, Providence, RI, 2005.
  7. K. T. Reed and J. R. Parker, "Automatic computer recognition of printed music," in Proceedings of International Conference on Pattern Recognition (ICPR'96), Vienna, Austria, 1996, pp. 803-807.
  8. A. Rebelo, G. Capela, and J. S. Cardoso, "Optical recognition of music symbols," International Journal on Document Analysis and Recognition, vol. 13, no. 1, pp. 19-31, 2010. https://doi.org/10.1007/s10032-009-0100-1
  9. P. Bellini, I. Bruno, and P. Nesi, "Optical music recognition: architecture and algorithms," in Interactive Multimedia Music Technologies. Hershey, PA: Information Science Reference, 2008, pp. 80-110.
  10. H. Miyao and Y. Nakano, "Note symbol extraction for printed piano scores using neural networks," IEICE Transactions on Information and Systems, vol. 79, no. 5, pp. 548-554, 1996.
  11. L. Pugin, "Optical music recognition of early typographic prints using hidden Markov models," in Proceedings of the 7th International Conference on Music Information Retrieval (ISMIR 2006), Victoria, Canada, 2006, pp. 53-56.
  12. L. Pugin, J. A. Burgoyne, and I. Fujinaga, "MAP adaptation to improve optical music recognition of early music documents using hidden Markov models," in Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR 2007), Vienna, Austria, 2007, pp. 513-516.
  13. N. Luangnapa, T. Silpavarangkura, C. Nukoolkit, and P. Mongkolnam, "Optical music recognition on android platform," in Advances in Information Technology. Heidelberg: Springe, 2012, pp. 106-115.
  14. T. Soontornwutikul, N. Thananart, A. Wantanareeyachart, C. Nukoolkit, and C. Arpnikanondt, "Optical music recognition on Windows Phone 7," in Proceedings of the 9th International Conference on Computing and Information Technology (IC2IT2013), Bangkok, Thailand, 2013, pp. 239-248.
  15. P. Bellini, I. Bruno, and P. Nesi, "Optical music sheet segmentation," in Proceedings of the 1st International Conference on Web Delivering of Music, Florence, Italy, 2001, pp. 183-190.
  16. S. Sheridan and S. E. George, "Defacing music scores for improved recognition," in Proceedings of the 2nd Australian Undergraduate Students' Computing Conference, Melbourne, Australia, 2004, pp. 142-148.
  17. V. Q. Nhat and G. Lee, "Adaptive line fitting for staff detection in handwritten music score images," in Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication (ICUIMC'14), Siem Reap, Cambodia, 2014.