Phonetics and Speech Sciences (말소리와 음성과학)

Korean Society of Speech Sciences (한국음성학회)
권호 표지
DOI QR코드

DOI QR Code

Computer-Based Fluency Evaluation of English Speaking Tests for Koreans

한국인을 위한 영어 말하기 시험의 컴퓨터 기반 유창성 평가

  • Received : 2014.03.11
  • Accepted : 2014.05.13
  • Published : 2014.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an automatic fluency evaluation algorithm for English speaking tests. In the proposed algorithm, acoustic features are extracted from an input spoken utterance and then fluency score is computed by using support vector regression (SVR). We estimate the parameters of feature modeling and SVR using the speech signals and the corresponding scores by human raters. From the correlation analysis results, it is shown that speech rate, articulation rate, and mean length of runs are best for fluency evaluation. Experimental results show that the correlation between the human score and the SVR score is 0.87 for 3 speaking tests, which suggests the possibility of the proposed algorithm as a secondary fluency evaluation tool.

Keywords

References

  1. Fillmore, C. J. (1979). On fluency. Individual differences in language ability and language behavior, 85-101.
  2. Chambers, F. (1997). What do we mean by fluency?. System, 25(4), 535-544. https://doi.org/10.1016/S0346-251X(97)00046-8
  3. Kormos, J., & Denes, M. (2004). Exploring measures and perceptions of fluency in the speech of second language learners. System, 32(2), 145-164. https://doi.org/10.1016/j.system.2004.01.001
  4. Malvern, D. D., & Richards, B. J. (1997). A new measure of lexical diversity. British Studies in Applied Linguistics, 12, 58-71.
  5. Neumeyer, L., Franco, H., Digalakis, V., & Weintraub, M. (2000). Automatic scoring of pronunciation quality. Speech Communication, 30(2), 83-93. https://doi.org/10.1016/S0167-6393(99)00046-1
  6. Young, S., Evermann, G., Gales, M., Hain, T., Kershaw, D., Liu, X., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., & Woodland, P. (2006). The HTK Book (for HTK version 3.4). Cambridge University Engineering Department, 2(2), 2-3.
  7. Paul, D. B., & Baker, J. M. (1992, February). The design for the Wall Street Journal-based CSR corpus. In Proceedings of the Workshop on Speech and Natural Language (pp. 357-362). Association for Computational Linguistics.
  8. Vertanen, K. (1994). HTK Wall Street Journal Training Recipe. http://www.keithv.com.
  9. Garofolo, J. S. (1988). Getting started with the DARPA TIMIT CD-ROM: An acoustic phonetic continuous speech database. National Institute of Standards and Technology (NIST), Gaithersburgh, MD, 107.
  10. Lenzo, K. (2007). The CMU pronouncing dictionary.
  11. Imai, S. (1983). Cepstral analysis synthesis on the mel frequency scale. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 93-96), IEEE.
  12. Shoup, J. E. (1980). Phonological aspects of speech recognition. Trends in Speech Recognition, 125-138.
  13. Haykin, S. (1999). Neural Networks, Prentice Hall.
  14. Muller, K. R., Smola, A. J., Ratsch, G., Scholkopf, B., Kohlmorgen, J., & Vapnik, V. (1997). Predicting time series with support vector machines. In Artificial Neural Networks-ICANN'97 (pp. 999-1004). Springer Berlin Heidelberg.
  15. Drucker, H., Burges, C. J., Kaufman, L., Smola, A., & Vapnik, V. (1997). Support vector regression machines. Advances in Neural Information Processing Systems, 9, 155-161.
  16. Smola, A. J., & Scholkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 14(3), 199-222. https://doi.org/10.1023/B:STCO.0000035301.49549.88
  17. Kendall, M. G. (1948). Rank correlation methods.
  18. Riggenbach, H. (1991). Toward an understanding of fluency: A microanalysis of nonnative speaker conversations. Discourse Processes, 14(4), 423-441. https://doi.org/10.1080/01638539109544795
  19. Towell, R., Hawkins, R., & Bazergui, N. (1996). The development of fluency in advanced learners of French. Applied Linguistics, 17(1), 84-119. https://doi.org/10.1093/applin/17.1.84

Cited by

  1. Fluency Scoring of English Speaking Tests for Nonnative Speakers Using a Native English Phone Recognizer vol.7, pp.2, 2015, https://doi.org/10.13064/KSSS.2015.7.2.149