DOI QR코드

DOI QR Code

A Proposed Framework for Evaluating the Return on Investment of E-Learning Programs at Saudi Universities

  • Hanaa Yamani (Faculty of computer and information systems, Umm Al-Qura University)
  • Received : 2023.02.05
  • Published : 2023.02.28

Abstract

The purpose of this study is to introduce a proposed Framework for Evaluating the Return on Investment (ROI) of E-Learning Programs at Saudi Universities. To achieve this goal, the descriptive analysis methodology is used to analyze the literature review about e-learning and its evaluation from different viewpoints, especially from the ROI-related perspective. As well as the literature reviews related to ROI and the methods of calculating it inside society institutes. This study suggests a conceptual framework for evaluating the ROI of E-Learning Programs at Saudi Universities. This framework is based on the merging process among the analyze, design, develop, implement, and evaluate (ADDIE) model for designing e-learning programs, which gives detailed procedures for executing the program, several evaluating models for e-learning, and the Kirkpatrick model for evaluating the ROI of e-learning. It consists of seven stages (analysis, calculating the costs, design, development, implementation, calculation of the benefits, and calculation of the final ROI).

Keywords

References

  1. M. Nichols, "The financial Benefits of Elearning, "Journal of Open, Flexible, and Distance Learning," vol. 8, no. 1, pp. 25-40, 2004.
  2. B. Mallinson and N. Nyawo, "A proposes Theoretical Model for Evaluating E- Learning," International Conference e-Learning (IADIS)., pp. 414-418. 2008
  3. D. Al-Fraihat, M. Joy, R. Masa'deh, and J. Sinclair, "Evaluating E-learning systems success: An empirical study," Computers in Human Behavior, vol. 102, no. 2020, pp. 67-86. 2020 https://doi.org/10.1016/j.chb.2019.08.004
  4. S. Ozkan and R. Koseler, " Multi-Dimensional Evaluation of ELearning Systems in the Higher Education Context: An Empirical Investigation of a Computer Literacy Course", Paper presented at 39th ASEE/IEEE Frontiers in Education Conference, October 18 - 21, San Antonio, TX, 2009
  5. M. Pour, M. Hosseinzadeh, M. Azar, and F. Taheri, (2017). Developing a new framework for evaluating e-learning systems: integrating BSC and FAHP," Kybernetes. Vol. 46, no 8, pp. 1303- 1324. 2017. https://doi.org/10.1108/K-02-2017-0060
  6. L. Dewi and B. Kartowagiran, "An evaluation of internship program by using Kirkpatrick evaluation model," REID (Research and Evaluation in Education). vol. 4, no. 2, pp. 55-163, 2018. https://doi.org/10.21831/reid.v4i2.22495
  7. M. Cahapay, "Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation,' . International Journal of Assessment Tools in Education. vol. 8, no. 1, pp. 135-144.
  8. S. Yardley and T. Dornan, "Kirkpatrick's levels and education 'evidence'. Medical Education. vol. 46, no. 1, pp. 97-106.
  9. D. L. Kirkpatrick, Evaluation of training. In R. L. Craig (Ed.), Training and development handbook: A guide to human resource development (2nd ed., pp. 301-319). McGraw-Hill , New York,1976
  10. R. Bates, " A critical analysis of evaluation practice: the Kirkpatrick Model and the principle of beneficence," Evaluation and Program Planning, vol. 27, pp. 341-347, 2004. https://doi.org/10.1016/j.evalprogplan.2004.04.011
  11. Everything you need to know to measure your Elearning ROI. Growth Engineering, August 31, 2021.[online]. Available at: https://www.growthengineering.co.uk/how-to-measure-your-elearning-roi/
  12. M. Rosenberg, E-Learning: Strategies for delivering knowledge in the digital age, McGraw-Hill, New York, 2001.
  13. H. A. Yamani, H. A., "A Conceptual Framework for Integrating Gamification in eLearning Systems Based on Instructional Design Model." International Journal of Emerging Technologies in Learning (iJET), vol. 16, no. 4, pp. 14-33. 2021. https://doi.org/10.3991/ijet.v16i04.15693
  14. C.A. Shoniregun and S.J. Gray, Is e-learning really the future or a risk?, May 3, 2003[Online]. Available at: https://dl.acm.org/doi/pdf/10.1145/777947.777948.
  15. K. Reshetilo, "How to Calculate Return on Investment (ROI) of eLearning?'. Retrieved May 3, 2021[ online]. Available at: https://greenice.net/calculate-return-investment-roi-elearning/
  16. H. M. Abdulghani, S. A. Shaik, N. Khamis, A. Al-Drees, M. Irshad, M. Khalil, A. Alhaqwi, and A. Isnani, "Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice, " Medical teacher. Vol. 36, no. 1, pp. 24-29.2014. https://doi.org/10.3109/0142159X.2014.886012
  17. DL. Kirkpatrick and JD. Kirkpatrick,The transfer of learning to behavior: Using the four levels to improve performance, Berrett-Koehler Publication, San Francisco, 2005.
  18. S. McGriff, "Instructional System Design (ISD) Using the ADDIE Model", April 5, 2000[Online] .Available at. https://www.lib.purdue.edu/sites/default/files/directory/butler38/ADDIE.pdf