Information Systems Review (경영정보학연구)

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지
DOI QR코드

DOI QR Code

The Effects of Gamification of e-Learning Platforms on Engagement: Focusing on Moderating Effects of Interaction, Difficulty, and Length

e-러닝 플랫폼의 게임화가 인게이지먼트에 미치는 영향: 상호작용, 스터디 난이도, 스터디 길이의 조절효과를 중심으로

  • Ohsung Kim (Industry-University Cooperation Foundation, Chungbuk National University Chungbuk Pro Makercenter) ;
  • Jungwon Lee (Sejong Research Institute, Korea University)
  • 김오성 (충북대학교 충북 Pro메이커센터 ) ;
  • 이중원 (고려대학교 세종캠퍼스 세종경영연구소 )
  • Received : 2023.09.05
  • Accepted : 2023.12.10
  • Published : 2024.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, e-learning platforms are rapidly growing by innovating the education industry by applying various IT technologies. Because student participation in the online environment is considered a prerequisite for learning, low participation rates are considered one of the most important issues determining the performance of e-learning platforms. Gamification has grown rapidly over the past decades and is highly valued for its applicability in education because it is expected to enhance learning motivation. However, despite the interest of researchers, previous studies have reported conflicting results on the effect of gamification on participation rates in the context of e-learning platforms, and have mainly studied structural gamification, but have not sufficiently addressed the effects of content gamification. In this context, this study aims to analyze the effect of content gamification on e-learning platform engagement and to explore the boundary conditions moderating this effect. For empirical analysis, 5,017 data registered from February 11, 2022 to May 31, 2022 were analyzed for the education platform entry (https://playentry.org). The propensity score matching method and Poisson multilevel regression model were applied as analysis methods. As a result of the analysis, content gamification had a statistically significant effect on engagement, and the interaction effects of interaction and content difficulty were statistically significant.

최근 e-러닝 플랫폼은 다양한 IT 기술을 적용하여 교육산업을 혁신하며 빠르게 성장하고 있다. 온라인 환경에서의 학생 참여는 학습에 필요한 전제 조건으로 간주 되기 때문에 낮은 참여율은 e-러닝 플랫폼 성과를 결정하는 가장 중요한 문제 중 하나로 여겨지고 있다. 한편 게임화는 지난 수십 년 동안 급속도로 성장했으며 학습 동기를 개선할 것으로 기대되기 때문에 효용 가치가 높게 평가되고 있다. 하지만, 연구자들의 관심에도 불구하고 선행연구는 e-러닝 플랫폼의 맥락에서 게임화가 참여율에 미치는 영향에 관해 상반된 결과를 보고하였으며, 구조적 게임화를 주로 연구하였을 뿐 콘텐츠 게임화의 효과에 대해서는 충분히 다루지 않았다는 한계점이 있다. 본 연구는 이러한 맥락에서 콘텐츠 게임화가 e-러닝 플랫폼 인게이지먼트에 미치는 영향을 분석하고 이러한 효과를 조절하는 경계조건을 탐색하고자 한다. 실증분석을 위해서는 네이버 커넥트재단에서 개발하고 운영하는 엔트리(playentry.org)를 대상으로 2022년 2월 11일부터 2022년 5월 31일까지 엔트리 공유하기에 등록된 5,017개의 데이터를 분석하였다. 분석방법으로는 성향점수매칭과 다수준 포아송 회귀모형을 적용하여 분석하였다. 분석결과 콘텐츠 게임화는 인게이지먼트에 통계적으로 유의한 영향을 미쳤으며, 상호작용, 콘텐츠 난이도의 상호작용 효과는 통계적으로 유의하였다.

Keywords

Acknowledgement

이 논문은 2022년도 네이버 커넥트재단 연구 과제 공모 지원을 받아 수행된 연구임.

References

  1. Alsawaier, R. S., "The effect of gamification on motivation and engagement", The International Journal of Information and Learning Technology, Vol.35, No.1, 2018, pp. 56-79. 
  2. Archambault, I., M. Janosz, J. Fallu, and L. S. Pagani, "Student engagement and its relationship with early high school dropout", Journal of Adolescence, Vol.32, No.3, 2008, pp. 651-670. 
  3. Arkorful, V. and N. Abaidoo, "The role of e-learning, advantages and disadvantages of its adoption in higher education", International Journal of Instructional Technology and Distance Learning, Vol.12, No.1, 2015, pp. 29-42. 
  4. Balau, N. and S. Utz, "Information sharing as strategic behaviour: The role of information display, social motivation and time pressure", Behaviour & Information Technology, Vol.36, No.6, 2016, pp. 589-605. 
  5. Bandura, A., "Self-efficacy: Toward a unifying theory of behavioral change", Psychological Review, Vol.84, No.2, 1977, pp. 191-215. 
  6. Baumeister, R. F. and M. R. Leary, "The need to belong: Desire for interpersonal attachments as a fundamental human motivation", Interpersonal Development, 2017, pp. 57-89. 
  7. Benta, D., G. Bologa, and I. Dzitac, "E-learning platforms in higher education case study", Procedia Computer Science, Vol.31, 2014, pp. 1170-1176. 
  8. Buttice, V., M. G. Colombo, and M. Wright, "Serial crowdfunding, social capital, and Project Success", Entrepreneurship Theory and Practice, Vol.41, No.2, 2017, pp. 183-207. 
  9. Chan, T. S. and T. C. Ahern, "Targeting motivation-adapting flow theory to instructional design", Journal of Educational Computing Research, Vol.21, No.2, 1999, pp. 151-163. 
  10. Clow, D., "An overview of learning analytics", Teaching in Higher Education, Vol.18, No.6, 2013, pp. 683-695. 
  11. Cole, M. T., D. J. Shelley, and L. B. Swartz, "Online instruction, e-learning, and student satisfaction: A three year study", The International Review of Research in Open and Distributed Learning, Vol.15, No.6, 2014, Available at: http://doi.org/10.19173/irrodl.v15i6.1748. 
  12. Csikszentmihalyi, M., Flow and the Foundations of Positive Psychology: The Collected Works of Mihaly Csikszentmihalyi, Springer, 2016. 
  13. Daghan, G. and B. Akkoyunlu, "Modeling the continuance usage intention of online learning environments", Computers in Human Behavior, Vol.60, 2016, pp. 198-211. 
  14. Debych, M. A., "Online learning: Advantages and disadvantages", Information Technologies and Management in Higher Education and Sciences, PART 1, 2022, available at:http://doi.org/10.30525/978-9934-26-277-7-65. 
  15. Deci, E. L. and R. M. Ryan, Handbook of Self-Determination Research, The University of Rochester Press, 2004. 
  16. Deci, E., R. Vallerand, L. Pelletier, and R. Ryan, "Motivation and education: The Self-Determination Perspective", Educational Psychologist, Vol.26, No.3, 1991, pp. 325-346. 
  17. Dehejia, R. H. and S. Wahba, "Propensity score-matching methods for nonexperimental causal studies", Review of Economics and Statistics, Vol.84,, No.1, 2002, pp. 151-161. 
  18. Deterding, S., "The lens of intrinsic skill atoms: A method for gameful design", Human-Computer Interaction, Vol.30, No.3-4, 2015, pp. 294-335. 
  19. Deterding, S., D. Dixon, R. Khaled, and L. Nacke, "From game design elements to gamefulness", Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, 2011, Available at: http://doi.org/10.1145/2181037.2181040. 
  20. Dichev, C., D. Dicheva, G. Angelova, and G. Agre, "From gamification to gameful design and gameful experience in learning", Cybernetics and Information Technologies, Vol.14, No.4, 2015, pp. 80-100. 
  21. Dominguez, A., J. Saenz-de-Navarrete, L. de-Marcos, L. Fernandez-Sanz, C. Pages, and J.-J. Martinez-Herraiz, "Gamifying learning experiences: Practical implications and outcomes", Computers & Education, Vol.63, 2013, pp. 380-392. 
  22. Duncan, K., A. Kenworthy, and R. McNamara, "The effect of synchronous and asynchronous participation on students' performance in online accounting courses", Accounting Education, Vol.21, No.4, 2012, pp. 431-449. 
  23. Eccles, J. S. and A. Wigfield, "Motivational beliefs, values, and goals", Annual Review of Psychology, Vol.53, No.1, 2002, pp. 109-132. 
  24. Hamari, J., J. Koivisto, and H. Sarsa, "Does gamification work?- A literature review of empirical studies on Gamification", 2014 47th Hawaii International Conference on System Sciences, 2014, Available at: http://doi.org/10.1109/hicss.2014.377. 
  25. Hansch, A., L. Hillers, K. McConachie, C. Newman, T. Schildhauer, and P. Schmidt, "Video and online learning: Critical reflections and findings from the Field", 2015, SSRN Electronic Journal, Available at: http://doi.org/10.2139/ssrn.2577882. 
  26. Hu, P. J.- H. and W. Hui, "Examining the role of learning engagement in technology-mediated learning and its effects on learning effectiveness and satisfaction", Decision Support Systems, Vol.53, No.4, 2012, pp. 782-792. 
  27. Huang, Y.-C., S. J. Backman, K. F. Backman, F. A. McGuire, and D. Moore, "An investigation of motivation and experience in virtual learning environments: A self-determination theory", Education and Information Technologies, Vol.24, No.1, 2018, pp. 591-611. 
  28. Jordan, K., "Massive open online course completion rates revisited: Assessment, length and attrition", The International Review of Research in Open and Distributed Learning, Vol.16, No.3, 2015, Available at: http://doi.org/10.19173/irrodl.v16i3.2112. 
  29. Kam and Umar, "Fostering authentic learning motivations through gamification: A self-determination theory (SDT) approach", Journal of Engineering Science and Technology, Vol.13, 2018, pp. 1-9. 
  30. Kangas, M., P. Siklander, J. Randolph, and H. Ruokamo, "Teachers' engagement and students' satisfaction with a playful learning environment", Teaching and Teacher Education, Vol.63, 2017, pp. 274-284. 
  31. Kapp, K. M., L. Blair, and R. Mesch, The Gamification of Learning and Instruction Fieldbook: Ideas into Practice, Wiley & Sons, 2014. 
  32. Kim, R. The Concept of Flow: A Critical Review of the Literature within Music, Sports, & Education, Biola University, 2016. 
  33. Kingsley, T. L. and M. M. Grabner-Hagen, "Gamification: Questing to integrate content knowledge, literacy, and 21st-century learning", Journal of Adolescent & Adult Literacy, Vol.59, No.1, 2015, pp. 51-61. 
  34. Klein, K. J., F. Dansereau, and R. J. Hall, "Levels issues in theory development, data collection, and analysis", Academy of Management Review, Vol.19, No.2, 1994, pp. 195-229. 
  35. Krajcik, J., P. Blumenfeld, R. Marx, K. Bass, J. Fredricks, and E. Soloway, "Inquiry in project-based science classrooms: Initial attempts by middle school students", Journal of the Learning Sciences, Vol.7, No.3, 1998, pp. 313-350. 
  36. Lahti, M., H. Hatonen, and M. Valimaki, "Impact of e-learning on nurses' and student nurses knowledge, skills, and satisfaction: A systematic review and meta-analysis", International Journal of Nursing Studies, Vol.51, No.1, 2014, pp. 136-149. 
  37. Lee, J. and C. Park, "Social media content, customer engagement and brand equity: US versus Korea", Management Decision, Vol.60, No.8, 2022, pp. 2195-2223. 
  38. Lee, J., H.-D. Song, and A. Hong, "Exploring factors, and indicators for measuring students' sustainable engagement in e-learning", Sustainability, Vol.11, No.4, 2019, p. 985. 
  39. Locke, E. A. and G. P. Latham, "Building a practically useful theory of goal setting and task motivation: A 35-year odyssey", American Psychologist, Vol.57, No.9, 2002, pp. 705-717. 
  40. Luarn, P., C.-C. Chen, and Y.-P. Chiu, "Enhancing intrinsic learning motivation through gamification: A self-determination theory perspective", The International Journal of Information and Learning Technology, 2023, Available at: http://doi.org/10.1108/ijilt-07-2022-0145. 
  41. Min, H., H. J. Kim, and S.-B. Lee, "Extending the challenge-hindrance stressor framework: The Role of Psychological Capital", International Journal of Hospitality Management, Vol.50, 2015, pp. 105-114. 
  42. Montmarquette, C., S. Mahseredjian, and R. Houle, "The determinants of University Dropouts: A bivariate probability model with sample selection", Economics of Education Review, Vol.20, No.5, 2001, pp. 475-484. 
  43. Paechter, M., B. Maier, and D. Macher, "Students' expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction", Computers & Education, Vol.54, No.1, 2010, pp. 222-229. 
  44. Phirangee, K. and A. Malec, "Othering in online learning: An examination of social presence, identity, and sense of community", Distance Education, Vol.38, No.2, 2017, pp. 160-172. 
  45. Poy, R. and A. Gonzales-Aguilar, "Factores de exito De Los Mooc: Algunas consideraciones criticas", Iberian Journal of Information Systems and Technologies, Vol.0, No.e1, 2014, Available at: http://doi.org/10.4304/risti.e1.105-118. 
  46. Richter, G., D. R. Raban, and S. Rafaeli, "Studying gamification: The effect of rewards and incentives on motivation", Gamification in Education and Business, 2014, pp. 21-46. 
  47. Rodrigues, H., F. Almeida, V. Figueiredo, and S. L. Lopes, "Tracking e-learning through published papers: A systematic review", Computers & Education, Vol.136, 2019, pp. 87-98. 
  48. Ryan, R. M. and E. L. Deci, "Intrinsic and extrinsic motivations: Classic definitions and New Directions", Contemporary Educational Psychology, Vol.25, No.1, 2000, pp. 54-67. 
  49. Schilling, A., T. Carl, and T. Hayashi, "Achievement motivation among high school basketball and cross-country athletes: A personal investment perspective", Journal of Applied Sport Psychology, Vol.13, No.1, 2001, pp. 103-128. 
  50. Seaborn, K. and D. I. Fels, "Gamification in theory and action: A survey", International Journal of Human-Computer Studies, Vol.74, 2015, pp. 14-31. 
  51. Varannai, I., P. Sasvari, and A. Urbanovics, "The use of gamification in Higher Education: An empirical study", International Journal of Advanced Computer Science and Applications, Vol.8, No.10, 2017, Available at: http://doi.org/10.14569/ijacsa.2017.081001. 
  52. Vasconcellos, D., P. D. Parker, T. Hilland, R. Cinelli, K. B. Owen, N. Kapsal, J. Lee, et al., "Self-determination theory applied to Physical Education: A systematic review and meta-analysis", Journal of Educational Psychology, Vol.112, No.7, 2020, pp. 1444-1469. 
  53. Vassileva, J., "Motivating participation in Social Computing Applications: A user modeling perspective", User Modeling and User-Adapted Interaction, Vol.22, No.1-2, 2012, pp. 177-201. 
  54. Vu, D., P. Pattison, and G. Robins, "Relational event models for social learning in moocs", Social Networks, Vol.43, 2015, pp. 121-135. 
  55. Wang, W., L. Guo, L. He, and Y. J. Wu, "Effects of social-interactive engagement on the dropout ratio in online learning: Insights from MOOC", Behaviour & Information Technology, Vol.38, No.6, 2018, pp. 621-636. 
  56. Wefald, A. J. and R. G. Downey, "Construct dimensionality of engagement and its relation with satisfaction", The Journal of Psychology, Vol.143, No.1, 2009, pp. 91-112. 
  57. Xu, D. and S. S. Jaggars, "The impact of online learning on students' course outcomes: Evidence from a large community and Technical College System", Economics of Education Review, Vol.37, 2013, pp. 46-57. 
  58. Xu, J., A. Lio, H. Dhaliwal, S. Andrei, S. Balakrishnan, U. Nagani, and S. Samadder, "Psychological interventions of virtual gamification within academic intrinsic motivation: A systematic review", Journal of Affective Disorders, Vol.293, 2021, pp. 444-465. 
  59. Young, A. and C. Norgard, "Assessing the quality of online courses from the students' perspective", The Internet and Higher Education, Vol.9, No.2, 2006, pp. 107-115.