Phonetics and Speech Sciences (말소리와 음성과학)

Korean Society of Speech Sciences (한국음성학회)
권호 표지
DOI QR코드

DOI QR Code

Evaluation of English speaking proficiency under fixed speech rate: Focusing on utterances produced by Korean child learners of English

  • Narah Choi (Department of English Linguistics, Hankuk University of Foreign Studies) ;
  • Tae-Yeoub Jang (Department of English Linguistics, Hankuk University of Foreign Studies)
  • Received : 2023.03.05
  • Accepted : 2023.03.20
  • Published : 2023.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study attempted to test the hypothesis that Korean evaluators can score L2 speech appropriately, even when speech rate features are unavailable. Two perception experiments-preliminary and main-were conducted sequentially. The purpose of the preliminary experiment was to categorize English-as-a-foreign-language (EFL) speakers into two groups-advanced learners and lower-level learners-based on the proficiency scores given by five human raters. In the main experiment, a set of stimuli was prepared such that the speech rate of all data tokens was modified to have a uniform speech rate. Ten human evaluators were asked to score the stimulus tokens on a 5-point scale. These scores were statistically analyzed to determine whether there was a significant difference in utterance production between the two groups. The results of the preliminary experiment confirm that higher-proficiency learners speak faster than lower-proficiency learners. The results of the main experiment indicate that under controlled speech-rate conditions, human raters can appropriately assess learner proficiency, probably thanks to the linguistic features that the raters considered during the evaluation process.

Keywords

Acknowledgement

This work was supported by Hankuk University of Foreign Studies Research Fund of 2023.

References

  1. Anwyl-Irvine, A. L., Massonnie, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020). Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods, 52(1), 388-407. https://doi.org/10.3758/s13428-019-01237-x
  2. Arevart, S., & Nation, P. (1991). Fluency improvement in a second language. RELC Journal, 22(1), 84-94. https://doi.org/10.1177/003368829102200106
  3. Baker-Smemoe, W., Dewey, D. P., Bown, J., & Martinsen, R. A. (2014). Does measuring L2 utterance fluency equal measuring overall L2 proficiency?: Evidence from five languages. Foreign Language Annals, 47(4), 707-728. https://doi.org/10.1111/flan.12110
  4. Boersma, P., & Weenink, D. (2021). Praat: Doing phonetics by computer (version 6.2.01) [Computer program]. Retrieved from http://www.praat.org/
  5. Bosker, H. R., Pinget, A. F., Quene, H., Sanders, T., & de Jong, N. H. (2013). What makes speech sound fluent? The contributions of pauses, speed and repairs. Language Testing, 30(2), 159-175. https://doi.org/10.1177/0265532212455394
  6. Corretge, R. (2012-2022). Praat vocal toolkit [Computer software]. Retrieved from https://www.praatvocaltoolkit.com
  7. Cucchiarini, C., Strik, H., & Boves, L. (2000). Quantitative assessment of second language learners' fluency by means of automatic speech recognition technology. The Journal of the Acoustical Society of America, 107(2), 989-999. https://doi.org/10.1121/1.428279
  8. Cucchiarini, C., Strik, H., & Boves, L. (2002). Quantitative assessment of second language learners' fluency: Comparisons between read and spontaneous speech. The Journal of the Acoustical Society of America, 111(6), 2862-2873. https://doi.org/10.1121/1.1471894
  9. De Jong, N. H., Steinel, M. P., Florijn, A., Schoonen, R., & Hulstijn, J. H. (2013). Linguistic skills and speaking fluency in a second language. Applied Psycholinguistics, 34(5), 893-916. https://doi.org/10.1017/S0142716412000069
  10. de Wet, F., Van der Walt, C., & Niesler, T. R. (2009). Automatic assessment of oral language proficiency and listening comprehension. Speech Communication, 51(10), 864-874. https://doi.org/10.1016/j.specom.2009.03.002
  11. Derwing, T. M., & Munro, M. J. (1997). Accent, intelligibility, and comprehensibility. Studies in Second Language Acquisition, 19(1), 1-16. https://doi.org/10.1017/S0272263197001010
  12. Flege, J. E. (1988). Factors affecting degree of perceived foreign accent in English sentences. The Journal of the Acoustical Society of America, 84(1), 70-79. https://doi.org/10.1121/1.396876
  13. Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 461-473. https://doi.org/10.1093/applin/amp048
  14. Housen, A., Kuiken, F., & Vedder, I. (2012). Complexity, accuracy and fluency. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA (pp. 1-20). John Benjamins. Amsterdam, the Netherlands.
  15. Huang, L. F., & Graf, T. (2020). Speech rate and pausing in English: Comparing learners at different levels of proficiency with native speakers. Taiwan Journal of TESOL, 17(1), 57-86.
  16. Jang, T. Y. (2009, November). Automatic assessment of non-native prosody using rhythm metrics: Focusing on Korean speakers' English pronunciation. Proceedings of the 2nd International Conference on East Asian Linguistics (ICEAL 2). Vancouver, BC.
  17. Kang, O. (2010). Relative salience of suprasegmental features on judgments of L2 comprehensibility and accentedness. System, 38(2), 301-315. https://doi.org/10.1016/j.system.2010.01.005
  18. Kang, O., Rubin, D., & Pickering, L. (2010). Suprasegmental measures of accentedness and judgments of language learner proficiency in oral English. The Modern Language Journal, 94(4), 554-566. https://doi.org/10.1111/j.1540-4781.2010.01091.x
  19. Kim, M. S. (2017). The effects of pause and speech rate in evaluating English speech (Unpublished Doctoral dissertation). Hankuk University of Foreign Studies, Seoul, Korea.
  20. Kormos, J., & Denes, M. (2004). Exploring measures and perceptions of fluency in the speech of second language learners. System, 32(2), 145-164. https://doi.org/10.1016/j.system.2004.01.001
  21. Munro, M. J., & Derwing, T. M. (2001). Modeling perceptions of the accentedness and comprehensibility of L2 speech: The role of speaking rate. Studies in Second Language Acquisition, 23(4), 451-468. https://doi.org/10.1017/S0272263101004016
  22. McAuliffe, M., Socolof, M., Mihuc, S., Wagner, M., & Sonderegger, M. (2017, August). Montreal forced aligner: Trainable text-speech alignment using kaldi. Proceedings of Interspeech 2017 (pp. 498-502). Stockholm, Sweden.
  23. Pickett, J. M. (1999). The acoustics of speech communication: Fundamentals, speech perception theory, and technology. Boston, MA: Allyn and Bacon.
  24. R Core Team. (2022). R: A language and environment for statistical computing (version 4.2.2) [Computer software]. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org
  25. Rhee, S. C., Lee, S. H., Kang, S. K., & Lee, Y. J. (2003). Design and construction of Korean-spoken English corpus (K-SEC). Malsori, 46, 159-174.
  26. Saito, K., Trofimovich, P., & Isaacs, T. (2016). Second language speech production: Investigating linguistic correlates of comprehensibility and accentedness for learners at different ability levels. Applied Psycholinguistics, 37(2), 217-240. https://doi.org/10.1017/S0142716414000502
  27. Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30(4), 510-532. https://doi.org/10.1093/applin/amp047
  28. Trofimovich, P., & Baker, W. (2006). Learning second language suprasegmentals: Effect of L2 experience on prosody and fluency characteristics of L2 speech. Studies in Second Language Acquisition, 28(1), 1-30. https://doi.org/10.1017/S0272263106060013
  29. Yang, S. H., & Chung, M. (2017, June). Linguistic factors affecting evaluation of L2 Korean speech proficiency. Proceedings of the 7th ISCA Workshop on Speech and Language Technology in Education (SLaTE 2017) (pp. 53-58). Stockholm, Sweden.
  30. Zhao, G., Sonsaat, S., Silpachai, A., Lucic, I., Chukharev-Hudilainen, E., Levis, J., & Gutierrez-Osuna, R. (2018, September). L2-ARCTIC: A non-native English speech corpus. Proceedings of Interspeech 2018 (pp. 2783-2787). Hyderabad, India.