DOI QR코드

DOI QR Code

Changes in the Recognition Rate of Kodály Learning Devices using Machine Learning

머신러닝을 활용한 코다이 학습장치의 인식률 변화

  • Received : 2024.04.15
  • Accepted : 2024.06.14
  • Published : 2024.06.30

Abstract

Kodály hand signs are symbols that intuitively represent pitch and note names based on the shape and height of the hand. They are an excellent tool that can be easily expressed using the human body, making them highly engaging for children who are new to music. Traditional hand signs help beginners easily understand pitch and significantly aid in music learning and performance. However, Kodály hand signs have distinctive features, such as the ability to indicate key changes or chords using both hands and to clearly represent accidentals. These features enable the effective use of Kodály hand signs. In this paper, we aim to investigate the changes in recognition rates according to the complexity of scales by creating a device for learning Kodály hand signs, teaching simple Do-Re-Mi scales, and then gradually increasing the complexity of the scales and teaching complex scales and children's songs (such as "May Had A Little Lamb"). The learning device utilizes accelerometer and bending sensors. The accelerometer detects the tilt of the hand, while the bending sensor detects the degree of bending in the fingers. The utilized accelerometer is a 6-axis accelerometer that can also measure angular velocity, ensuring accurate data collection. The learning and performance evaluation of the Kodály learning device were conducted using Python.

Keywords

References

  1. Ahn, H. J. (2019). Door opening hand gesture recognition system using artificial neural networks (Master's thesis). University of Seoul, Graduate School.
  2. Choi, S. G. (2009). A study on effective teaching methods of Sijo singing using the Kodaly method (Master's thesis). Yonsei University, Graduate School of Education.
  3. Costante, G., Porzi, L., Lanz, O., Valigi, P., & Ricci, E. (2014). Personalizing a smartwatch-based gesture interface with transfer learning. In Proceedings of Signal Processing Conference (EUSIPCO) (pp. 2530-2534).
  4. Han, J. S. (2010). The effect of singing instruction using the Kodaly method on the music listening ability of children with disabilities (Master's thesis). Korea National University of Education, Graduate School of Education.
  5. Kang, M. J. (2009). The effect of the Kodaly method on young children's musicality (Master's thesis). Chongshin University.
  6. Kim, J. H. (2013). Implementation of a real-time number recognition system based on hand gesture using gradient and position information. Journal of KIISE: Software and Data Engineering, 2(3), 199-204.
  7. Kim, J. M. (2004). The impact of the Kodaly method on improving aural skills (Master's thesis). Gyeongin National University of Education, Graduate School of Education.
  8. Ren, Z., Yuan, J., Meng, J., & Zhang, Z. (2013). Robust part-based hand gesture recognition using Kinect sensor. IEEE Transactions on Multimedia, 15(5), 1110-1120. https://doi.org/10.1109/TMM.2013.2246148
  9. Song, G. J. (2006). A study on Zoltan Kodaly's music education method (Master's thesis). Mokpo National University, Graduate School of Education.
  10. Yu, C., Wang, X., Huang, H., Shen, J., & Wu, K. (2010, October). Vision-based hand gesture recognition using combinational features. In Proceedings of 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (pp. 543-546).