A Study on the Use of Artificial Intelligence Chatbots for Improving English Grammar Skills

영어 문법 실력 향상을 위한 인공지능 챗봇 활용에 관한 연구

  • Kim, Na-Young (Department of General Education, Sehan University)
  • Received : 2019.05.28
  • Accepted : 2019.08.20
  • Published : 2019.08.28


The purpose of this study is to explore the effects of the use of artificial intelligence chatbots on improving Korean college students' English grammar skills. 70 undergraduate students participated in the present study. They were taking a General English class offered by a university in Korea. There were two groups in this study. Participants in the chatbot group consisted of 36 students while those in the human group were 34. Over 16 weeks, the chatbot group engaged in ten chat sessions with a chatbot while the human group had a chat with a human chat partner. Both pre- and post-tests were performed to examine changes in the participants' grammar skills over time. To compare the improvement between the two groups, an independent t-test was then run. Main findings are as follows: First, participants in both groups significantly improved their English grammar skills, indicating the beneficial effects of engaging in chat. Also, there was a statistically significant difference in the improvement between the chatbot and human groups, indicating the superior effects of the chatbot use. This study confirmed the improved grammar skills by the participants in the chatbot group, comparison with those in the human group. Based on these findings, suggestions for the future chatbot study are discussed.


  1. B. A. Shawar & E. Atwell. (2007). Fostering language learner autonomy via adaptive conversation tutors. Proceedings from the Fourth Corpus Linguistics Conference. Birmingham, UK. Retrieved from
  2. N. Y. Kim. (2017). A study on different types of speech acts in voice-chat between EFL students and a chatbot. Studies in English Education, 22(3), 81-109. DOI:
  3. L. Fryer & R. Carpenter. (2006). Bots as language learning tools. Language, Learning & Technology, 10(3), 8-14. Retrieved from
  4. Y. Wang. (2004). Distance language learning: Interactivity and fourth-generation Internet-based videoconferencing. CALICO Journal, 21(2), 373- 395. DOI:
  5. L. Williams & R. A. van Compernolle. (2009). The Chatbot as a peer/tool for learners of French. In L. Lomicka & G. Lord (Eds.), The next generation: Social networking and online collaboration in foreign language learning (pp. 145-172). San Marcos, Texas: CALICO. Retrieved from
  6. J. Jia. (2009). CSIEC: A computer assisted English learning chatbot based on textual knowledge and reasoning. Knowledge-Based Systems, 22(4), 249- 255. DOI:
  7. N. Y. Kim. (2016). Effects of voice chat on EFL learners' speaking ability according to proficiency levels. Multimedia-Assisted Language Learning, 19(4), 63-88. DOI:
  8. Y. S. Kim. (2001). A survey study of US EFL teachers in Korea. In D. E. Shaffer (Ed.), Proceedings of the 9th Korea TESOL International Conference (pp. 173-185). Seoul, Korea. Retrieved from
  9. D. Kang. (2017). EFL learner and teacher beliefs about grammar learning in Korea. English Teaching, 72(2), 51-69. DOI:
  10. J. Hsu. (2018). App roundup: Four AI chatbots, from good to possibly evil. Retrieved from
  11. N. Y. Kim. (2016). Effects of different voice-chat conditions on Korean EFL learners' speaking ability, oral interaction, and affective factors. Unpublished doctoral dissertation, Ewha Womans University, Korea. Retrieved from
  12. J. I. Han & N. Y. Kim. (2016). The effects of post-task CMC activities and task types on Korean EFL learners' oral performance. STEM Journal, 17(2), 105-131. DOI:
  13. D. Gonzalez. (2003). Teaching and learning through chat: A taxonomy of educational chat for EFL/ESL. Teaching English with Technology, 3(4), 57-69. Retrieved from
  14. I. C. Choi. (2008). The impact of EFL testing on EFL education in Korea. Language Testing, 25(1), 39-62. DOI:
  15. I. C. Choi., & Y. Moon. (2018). A comparability study of two standardized English as a foreign language tests. Language Research, 54(2), 277-329. DOI:
  16. P. Chandrayan. (2019, April 15). Understanding AI chatbots, challenges, opportunities, and beyond. Toward Data Science. Retrieved from
  17. R. McGrath. (2018, April 22). How to increase conversions by personalizing your chatbot. Chatbots Magazine. Retrieved from
  18. M. Alemi, A. Meghdari & M. Ghazisaedy. (2014). Employing humanoid robots for teaching English language in Iranian junior high-schools. International Journal of Humanoid Robotics, 11(3), 1-25. DOI:
  19. Y. C. Sun & F. Y. Yang. (2015). I help, therefore, I learn: Service learning on Web 2.0 in an EFL speaking class. Computer-Assisted Language Learning, 28(3), 202-219. DOI:
  20. J. Tian & Y. Wang. (2010). Taking language learning outside the classroom: Learners' perspectives of eTandem learning via Skype. Innovation in Language Learning and Teaching, 4(3), 181-197. DOI:
  21. N. Y. Kim. (2018). A study on chatbots for developing Korean college students' English listening and reading skills. Journal of Digital Convergence, 16(8), 19-26. DOI:
  22. S. Lee, H. Noh, J. Lee, K. Lee, G. G. Lee, S. Sagong & M. Kim (2011). On the effectiveness of robot-assisted language learning. ReCALL, 23(1), 25-58. DOI:
  23. E. M. Brooks. (2018). Incorporating pop culture in formal and informal learning environments for L2 students. The TFLTA Journal, 7, 29-37. Retrieved from