International Journal of Contents

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

A Hierarchical Evaluation for Success Factors of the Mobile-Assisted Language Learning Using AHP

  • Received : 2017.05.22
  • Accepted : 2017.08.07
  • Published : 2017.09.28
Download PDF
⟨ Previous Next ⟩

Abstract

With tremendous advancement of information and communication technologies, mobile learning systems have been widely adopted in language learning contexts, and several frameworks have been developed for identifying and categorizing different factors of mobile-assisted language learning (MALL). However, pre-existing frameworks have limitations when evaluating the importance level of criteria. The purpose of this study is to develop a comprehensive hierarchical framework for identifying and categorizing success factors of MALL and prioritizing them according to the importance level. To do that, AHP method is used to quantitatively estimate weight values of MALL criteria. Results reveal that the priority of MALL criteria is ordered as follows: content, system, learner, language learning. Local weights of each criterion are also analyzed; for example, usefulness, accuracy, and authenticity are critical factors for improving MALL contents. Ease of use and mobility of MALL systems are also considered more critical than other systematic factors. In addition, availability of immediate feedback and self-directness has the highest weight values of importance. The findings of the study are discussed regarding hierarchical orders of MALL criteria and conclude that successful MALL implementation may be achieved if related elements are diversely measured and evaluated. Pedagogical implications and suggestions for further research are also presented.

Keywords

References

  1. M. Sharples, "The Design of Personal Mobile Technologies for Lifelong Learning," Computers and Education, vol. 34, 2000, pp. 177-193. https://doi.org/10.1016/S0360-1315(99)00044-5
  2. P. Thornton and C. Houser, "Using Mobile Phones in English Education in Japan," Journal of Computer Assisted Learning, vol. 21, 2005, pp. 217-228. https://doi.org/10.1111/j.1365-2729.2005.00129.x
  3. A. Kukulska-Hulme and L. Shield, "An Overview of Mobile Assisted Language Learning: From Content Delivery to Supported Collaboration and Interaction," ReCALL, vol. 20, no. 3, 2008, pp. 271-289.
  4. G. F. Issa and H. Al-Bahadili, "A Scalable Framework to Quantitatively Evaluate Success Factors of Mobile Learning System," Int. J. Mobile Learning and Organisation, vol. 5, no. 3/4, 2011, pp. 299-316. https://doi.org/10.1504/IJMLO.2011.045319
  5. G. Stockwell and P. Hubbard, "Some Emerging Principles for Mobile-Assisted Language Learning," Monterey, CA: The International Research Foundation for English Language Education, 2013.
  6. M. Shanmugapriya and A. Tamilarasi, "Design and Development of Mobile-Assisted Language Learning (MALL) Application for English Language Using Android Push Notification Services," International Journal of Research in Computer and Communication Technology, vol. 2, no. 6, Jun. 2013, pp. 329-338.
  7. Y. C. Choi, J. H. Lee, and H. J. Lee, "Prioritizing Major Policy Issues Regarding the Smart Schooling System Using the AHP Method," International Journal of u- and e-Service, Science and Technology, vol. 9, no. 5, 2016, pp. 227-236.
  8. Ministry of Science, ICT and Future Planning, 2016 Korea's Wireless Internet Industry Map, Statistics Report, 10-10-2016.
  9. J. Burston, "Mobile-Assisted Language Learning: A Selected Annotated Bibliography of Implementation Studies 1994-2012," Language Learning & Technology, vol. 17, no. 3, 2013, pp. 157-225.
  10. J. Barbosa, R. Hahn, D. Barbosa, and C. Geyer, "Mobile and Ubiquitous Computing in an Innovative Undergraduate Course," Proc. of the 38th ACM Technical Symposium on Computer Science Education, ACM Press, 2007, pp. 379-383.
  11. L. Naismith, R. Lonsdale, G. Vavoula, and M. Sharples, "Literature Review in Mobile Technologies and Learning," Futurelab, Bristol, U.K., Tech. Rep. 11, 2005.
  12. J. Traxler, "Defining, Discussing, and Evaluating Mobile Learning: The Moving Finger Writes and having Write," International Review of Research in Open and Distance Learning, vol. 8, no. 2, 2007, 1-12.
  13. T. L. Saaty, "Decision Making with the Analytic Hierarchy Process," Int. Journal Service Sciences, vol. 1, no. 1, 2008, pp. 83-98. https://doi.org/10.1504/IJSSCI.2008.017590
  14. T. L. Saaty, "A Scaling Method for Priorities in Hierarchical Structures," Journal of Mathematical Psychology, vol. 15, no. 2, 1977, pp. 234-281. https://doi.org/10.1016/0022-2496(77)90033-5
  15. T. L. Saaty, The analytic hierarchy process, McGraw-Hill, New York, 1980.
  16. T. L. Saaty, Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World, RWS publications, 1990.
  17. S. J. Sohn, and S. W. Kim, "The Effects of KPI Weight based on AHP and KPI Use on Corporate Performance," Korean Academic Society of Accounting, vol. 17, no. 3, Sep. 2012, pp. 375-397.
  18. C. G. Seo, "Study on the e-Learning Quality Evaluation Using AHP," The Journal of Internet Electronic Commerce Research, vol. 15, no. 4, Aug. 2015, pp. 337-347.
  19. W. Y. Chiu, Y. D. Lee, and T. Y. Lin, "Performance Evaluation Criteria for Personal Trainers: An Analytical Hierarchy Process Approach," Social Behavior and Personality, vol. 38, no. 7, 2010, pp. 895-906. https://doi.org/10.2224/sbp.2010.38.7.895
  20. S. Farid, R. Ahmad, and M. Alam, "A Hierarchical Model for e-Learning Implementation Challenges Using AHP," Malaysian Journal of Computer Science, vol. 28, no. 3, 2015, pp. 166-188. https://doi.org/10.22452/mjcs.vol28no3.1
  21. D. Y. Jeong and S. M. Kang, "Perceived Importance of e-Learning Success Factors: An Empirical Assessment of e-Learning Firms," The Journal of Internet Electronic Commerce Research, vol. 4, no. 3, Dec. 2004, pp. 15-41.
  22. K. Bunruamkaew, How to do AHP analysis in Excel, PPT in Graduate School, University of Tsukuba, 2012.
  23. J. Y. Kim and S. Y. Hwang, "The AHP Model for Evaluating the Leadership of PR Middle-level Managers," The Korean Journal of Advertising, vol. 26, no. 1, 2015, pp. 207-234. https://doi.org/10.14377/KJA.2015.1.15.207
  24. B. C. Kim, M. I. Choi, and Y. M. Kim, "AHP Analysis on Relative Importance of Ad Creativity Evaluation Factors," The Korean Journal of Advertising, vol. 26, no. 3, 2015, pp. 61-80. https://doi.org/10.14377/KJA.2015.4.15.61