Empirical Analysis of the Effect of Avatars on Learner's e-Learning Performance : Emphasis on Trust Transference between Avatars and Contents

아바타가 학습자 이러닝 성과에 미치는 영향에 관한 실증연구:아바타와 학습내용간 신뢰전이를 중심으로

  • Published : 2009.12.31

Abstract

In the recent e-learning environment, avatars are often used to help learners get familiar with the contents, which is ultimately to motivate them to study more. Therefore, it is important to investigate whether avatars have actually the desirable effect on users of e-learning materials. Surprisingly, however, no extensive study has been conducted on this crucial issue Accordingly, main objectives this study are summarized as follows. First, we need to gain better understanding of how much learners' trust towards avatars (termed as "avatar trust") is transferred to learners' trust towards e-learning contents (termed as "contents trust"). Second, we need to investigate how much learners' personal relationships with avatars as well as learning behaviors change depending on avatar types (attractive vs. professional) and contents complexity (easy vs. difficult). As described in the study objectives, in order for us to analyze empirical data more systematically, we classified avatar types into two: "attractive" and "professional;" the contents are categorized as either "easy" or "difficult." Therefore, it is essential for this study to build a prototype e-learning website on which our research purpose can be realized and tested effectively with proper avatar types and e-learning contents. For this purpose, we built a prototype e-learning website, in which avatars are invited from currently working avatar instructors used in real-world e-learning websites, and e-learning contents are adapted from real-world contents about Java programming topic, which have been proved to have shown high quality and reliability. Our research method includes questionnaire survey by inviting a number of valid respondents comprised of office workers who are believed to have high demands for the e-learning contents as well as those who have previous experience with avatar instructors. Respondents were given one of the four e-learning experiment conditions (2 avatar types x 2 contents types) on a random basis. Each experimental e-learning condition is framed to have the same quality but different avatar type and content complexity. Then the respondents are asked to fill out the survey form which has questions about avatar trust, contents trust, personal relationships with avatar, and learning behavior, among others. Regarding the constructs used in research model, we based them rigorously on previous studies. For example, we used six constructs such as behavior to give information (BGI), behavior to obtain information (BOI), need for inclusion wanted, need for control wanted, contents trust, and avatar trust. To measure them, 7-Likert scales were used in the questionnaire. E-learning performance was measured indirectly through two constructs such as BGI and BOI. Six constructs used in the research model were adopted and revised from the FIRO-B model suggested by Schutz. Empirical results are as follows: First, professional avatars are more effective for difficult contents, while attractive avatars were not as effective for easy contents. Second, our study results ascertained that avatar trust transfers to contents trust regardless of avatar types and contents complexity.

Keywords

References

  1. Anderson, T., 'Getting the Mix Right Again: An Updated and Theoretical Rationale for Interaction,' International Review of Research in Open and Distance Learning, Vol. 4, No. 2, 2003, pp. 9-14
  2. Bhattacharya, R., Devinney, T.M., and Pillutla, M.M., 'A Formal Model of Trust Based on Outcomes,' Academy of Management Review, Vol. 23, 1998, pp. 459-472 https://doi.org/10.2307/259289
  3. Bhattacherjee, A., 'Individual Trust in Online Firms: Scale Development and Initial Test,' Journal of Management Information Systems, Vol. 19, 2002, pp. 211-241 https://doi.org/10.1080/07421222.2002.11045715
  4. Blakelock, J. and Smith, T.E., 'Distance Learning: From Multiple Snapshots, a Composite Portrait,' Computers and Composition, Vol. 23, No. 1, 2006, pp. 139-161 https://doi.org/10.1016/j.compcom.2005.12.008
  5. Butler, J.K. Jr., 'Toward Understanding and Measuring Conditions of Trust; Evaluation of a Conditions of Trust Inventory,' Journal of Management, Vol. 17, 1991, pp. 643-663 https://doi.org/10.1177/014920639101700307
  6. Chin, W.W. (ed.) The Partial Least Squares Approach to Structural Equation Modeling. Lawrence Erlbaum Associates, NJ, 1998
  7. Chin, W.W., Marcolin, B.L., and Newsted, P.R., 'A Partial Least Squares Latent Variable Modeling Approach for measuring Interaction Effect: Results from a Monte Carlo Simulation Study and Voice Mail Emotion/adoption Study,' 17th International Conference on Information Systems, OH, 1996, pp. 21-41
  8. Collis, B., 'Anticipating the Impact of Multimedia in Education: Lessons from the Literature,' Computers in Adult Education and Training, Vol. 2, No. 2, 1995
  9. Daniel, J. and Marquis, C., 'Interaction and Independence: Getting the Mixture Right,' Teaching at a Distance, Vol. 15, 1979, pp. 25-44
  10. Dillon, C.L. and Gunawardena, C.N., 'A Framework for the Evaluation of Telecommunications-Based Distance Education,' in: Selected Papers from the 17th World Congress of the International Council for Distance Education, D. Sewart (ed.), Open University, Milton Keynes, U.K., 1995
  11. Feick, L. and Higie, R.A., 'The Effects of Preference Heterogeneity and Source Characteristics on Ad Processing and Judgment about Endorsers,' Journal of Advertising, Vol. 21, No. 2, June 1992
  12. Fletcher, G.J.O. and Fincham, F.D., 'Attribution Processes in Close Relationships,' in: Cognition in Close Relationships, G.J.O. Fletcher and F.D. Fincham (eds.), Eribaum, Hillsdale, NJ, 1991, pp. 7-35
  13. Fornell, C. and David, F.L., 'Evaluating Structural Equation Models with Unobservable Variables and Measurement Error,' Journal of Marketing Research, 1981, pp. 39-50 https://doi.org/10.2307/3151312
  14. Gambetta, D., Trust: Making and Breaking Cooperative Relations, Blackwell, Oxford, UK: Basil, 1988
  15. Ganesan, S., 'Determinants of Long-term Orientation in Buyer-Seller Relationship,' Journal of Marketing, Vol. 58, 1994, pp. 1-19 https://doi.org/10.2307/1252265
  16. Gefen, D. and Straub, D., 'A Practical Guide to Factorial Validity Using PLS-Graph: Tutorial and Annotated Example,' Communications of the Association for Information Systems, Vol. 16, 2005, pp. 91-109
  17. Gefen, D., Straub, D.W., and Boudreau, M.C., 'Structural Equation Modeling and Regression: Guidelines for Research Practice,' Communications of the Association for Information Systems, Vol. 4, Article 7, August 2000, pp. 1-77
  18. Haimerl, C. and Fries, S., 'Self-Fulfilling Prophecies in Media-Based Learning: Content Relevance Moderates Quality Expectation Effects on Academic Achievement,' Learning and Instruction, doi:10.1016/j.learninstruc.2009.07.002, 2009
  19. Hair, J.F., Jr., Anderson, R.E., Tatham, R. L., and Black, W.C., Multivariate Data Analysis, Prentice-Hall International, Upper Saddle River, NJ, 1998
  20. Harrison, P.J., Saba, F., Seeman, B.J., Molise, G., Behm, R., and Williams, M.D., 'Development of Distance Education Assessment Instrument,' Educational Technology Research and Development, Vol. 39, No. 4, 1991, pp. 65-77 https://doi.org/10.1007/BF02296572
  21. Holzwarth, M., Janiszewski, C., and Neumann, M.M., 'The Influence of Avatars on Online Consumer Shopping Behavior,' American Marketing Association, Vol. 70, No. 4, 2006, pp. 19-36
  22. Homan, G. and Macpherson, A., 'E-learning in the Corporate University,' Journal of European Industrial Training, Vol. 29, No. 1, 2005, pp. 75-90 https://doi.org/10.1108/03090590510576226
  23. Hong, S.J., Jang, E.J., and Seo, Y.K., 'The Study on Identifying Competency Model for Professors in Distance Education,' The Journal of Educational Information and Media, Vol. 10, No. 2, 2004, pp. 81-112
  24. Hurley, J.R., 'Does FIRO-B Relate Better to Interpersonal or Intrapersonal Behavior?,' Journal of Clinical Psychology Vol. 46, No. 4, 1990, pp. 454-460 https://doi.org/10.1002/1097-4679(199007)46:4<454::AID-JCLP2270460413>3.0.CO;2-K
  25. Jonassen, D.H., 'Computers as Cognitive Tools: Learning with Technology, not from Technology,' Journal of Computing in Higher Education, Vol. 6, No. 2, 1995, pp. 40-73 https://doi.org/10.1007/BF02941038
  26. Jung, K.S. and Kim, K.J., 'Factors Influencing the Learning Effectiveness and Transfer of e-Learning in Business Organizations,' The Journal of Information Systems, Vol. 15, No. 2, 2006, pp. 1-29
  27. Kelman, H.C., 'Processes of Opinion Change,' Public Opinion Quarterly, Vol. 25, No. 1, Spring61, 1961, pp. 57-78 https://doi.org/10.1086/266996
  28. Kolb, D.A., Experiential Learning: Experience as the Source of Learning and Development, Prentice Hall, Englewood Cliffs, NJ, 1984
  29. Kumar, N., 'The Power of Trust in Manufacturer-Retailer Relationships,' Harvard Business Review, Vol. 74, 1996, pp. 93-106
  30. Lee, H., 'Case Study about Types of Avatar as an Important Factor of Communication,' Journal of Digital Design, Vol. 9, 2005, pp. 92-99
  31. Lee, K.C., Kang, B.U., Suh, B., and Kim, J.U., 'Exploring the Influence of the Internet Shopping Mall's Quality Factors on User Trust and Acceptance,' Korean Management Science Review, Vol. 22, No. 1, 2005, pp. 27-46
  32. Lou, Y., Bernard, R.M., and Abrami, P.C., 'Media and Pedagogy in Undergraduate Distance Education: A Theory-Based Meta- Analysis of Empirical Literature,' Educational Technology Research and Development, Vol. 5, No. 2, 2006, pp. 141-176
  33. Mayer, R., Davis, J., and Shoorman, F., 'An Integrative Model of Organizational Trust,' Academy of Management Review, Vol. 20, 1995, pp. 709-734 https://doi.org/10.2307/258792
  34. McGinnies, E. and Ward, C., 'Better Liked than Right: Trustworthiness and Expertise as Factors in Credibility,' Personality and Social Psychology Bulletin, Vol. 6, No. 3, 1980, pp. 467-472 https://doi.org/10.1177/014616728063023
  35. McKnight, D.H., Choudhury, V., and Kacmar, C., 'Developing and Validating Trust Measures for e-Commerce: An Integrative Typology,' Information Systems Research, Vol. 13, No. 3, 2002, pp. 334-359 https://doi.org/10.1287/isre.13.3.334.81
  36. Milliman, R.E. and Fugate, D.L., 'Using Trust-Transference As A Persuasion Technique: An Empirical Field Investigation,' Journal of Personal Selling and Sales Management, Vol. 8, No. 2, 1988, p. 1
  37. Moon, B.S., Lee, K.C., Jo, C.H., and Kang, S.J., 'An Empirical Analysis Approach to Investigating the Influence of Online Community Site Trust on Its Community Forum Activity,' Journal of the Korean Society for Information Management, Vol. 24, No. 1, 2007, pp. 227-250 https://doi.org/10.3743/KOSIM.2007.24.1.227
  38. Moore, M., 'Three types of interaction,' American Journal of Distance Education, Vol. 3, No. 2, 1989, pp. 1-6 https://doi.org/10.1080/08923648909526659
  39. Moorman, C., Deshpande, R., and Zaltman, G., 'Factors Affecting Trust in Market Research Relationships,' Journal of Marketing, Vol. 57, 1993, pp. 81-101 https://doi.org/10.2307/1252059
  40. Olfman, L., Bostrom, R.P., and Sein, M.K., 'Developing training strategies with an HCI perspective,' in: Human-Computer Interaction and Management Information Systems: Applications, D. Galletta and P. Zhang (eds.), M.E. Sharpe, Armonk, NY, 2006, pp. 258-283
  41. Park, S.C. and Kim, W.J., 'Trust Transfer between Small Package Express Services and Electronic Stores-A Perspective on Moderating Roles of Word of Mouth in Online Environments,' Korea Logistics Review, Vol. 17, No. 4, 2007, pp. 131-158
  42. Peltier, J.W., Schibrowsky, J.A., and Drago, W., 'The Interdependence of the Factors Influencing the Perceived Quality of the Online Learning Experience: A Causal Model,' Journal of Marketing Education, Vol. 29, 2007, pp. 140-153 https://doi.org/10.1177/0273475307302016
  43. Ridings, C., Gefen, D., and Arinze, B., 'Some Antecedents and Effects of Trust in Virtual Communities,' Journal of Strategic Information Systems, Vol. 11, 2002, pp. 271-295 https://doi.org/10.1016/S0963-8687(02)00021-5
  44. Ryu, I., 'Factors Influencing the Effectiveness of Web-Based Distance Learning,' Management Education Review, Vol. 6, No. 2, 2003
  45. Santhanam, R., Sasidharan, S., and Webster, J., 'Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training,' Information Systems Research, Vol. 19, No. 1, 2008, pp. 26-47 https://doi.org/10.1287/isre.1070.0141
  46. Sasidharan, S., and Santhanam, R., 'Technology-Based Training: Toward a Learner Centric Research Agenda,' in: Human-Computer Interaction and Management Information Systems: Applications, D. Galletta and P. Zhang (eds.), M.E. Sharpe, Armonk, NY, 2006, pp. 247-257
  47. Schindler, P.L. and Thomas, C.C., 'The Structure of Interpersonal Trust in the Workplace,' in: Organizational Behavior(8th), S.P. Robbins (ed.), Prentice-Hall, Inc., New Jersey, 1993
  48. Schutz, W.C., FIRO: A Three Dimensional Theory of Interpersonal Behavior, Holt, Rinehart and Winston, New York, 1958
  49. Schutz, W.C., The Interpersonal Underworld, Science and Behavior Books, Palo Alto, Calif., 1966
  50. Shin, N., 'Transactional Presence as a Critical Predictor of Success in Distance Learning,' Distance Education, Vol. 24, No. 1, 2003, pp. 69-86 https://doi.org/10.1080/01587910303048
  51. Shroff, R.H., Vogel, D., Coombes, J., and Lee, F., 'Student E-Learning Intrinsic Motivation: A Qualitative Analysis,' Communications of AIS, 2007, pp. 241-260
  52. Simmering, M.J., Posey, C., and Piccoli, G., 'Computer Self-Efficacy and Motivation to Learn in a Self-Directed Online Course,' Decision Sciences Journal of Innovative Education, Vol. 7, 2009, pp. 99-121 https://doi.org/10.1111/j.1540-4609.2008.00207.x
  53. Sitzmann, T., Kraiger, K., Stewart, D., and Wisher, R., 'The Comparative Effectiveness of Web-Based and Classroom Instruction: A Meta-Analysis,' Personnel Psychology, Vol. 59, No. 3, 2006, pp. 623-664 https://doi.org/10.1111/j.1744-6570.2006.00049.x
  54. Son, D.H. and Kim, H.J., 'The Effect of the Determinants of Distance-Learning on the Effectiveness of Education,' Information Systems Review, Vol. 10, No. 2, 2008, pp. 49-70
  55. Stewart, K.J., 'Trust transfer on the World Wide Web,' Organization Science, Vol. 14, 2003, pp. 5-17 https://doi.org/10.1287/orsc.14.1.5.12810
  56. Straub, D., Limayem, M., and Karahanna-Evaristo, E., 'Measuring System Usage: Implications for IS Theory Testing,' Management Science, Vol. 41, 1995, pp. 1328-1342 https://doi.org/10.1287/mnsc.41.8.1328
  57. Uzzi, B., 'The Sources and Consequences of Embeddedness for the Economic Performance of Organizations: The Network Effect,' American Sociological Review, Vol. 61, No. 4, 1996, pp. 674-698 https://doi.org/10.2307/2096399
  58. Wang, Y. and Fesenmaier, D.R., 'Towards Understanding Members' General Participation in and Active Contribution to an Online Travel Community,' Tourism Management, Vol. 25, No. 6, 2004, pp. 709-722 https://doi.org/10.1016/j.tourman.2003.09.011
  59. Webster, J. and Hackley, P., 'Teaching Effectiveness in Technology-Mediated Distance Learning,' Academy of Management Journal, Vol. 40, 1997, pp. 1282-1309 https://doi.org/10.2307/257034
  60. Wold, H., 'Soft Modelingthe Basic Design and Some Extensions, in System Under Indirect Observations:Part 2,' K.G. Joreskog and H. Wold (eds.), Amsterdam North-Holland, 1982
  61. Wood, J.A., Boles, J.S., and Babin, B.J., 'The Formation of Buyer's Trust of the Seller in an Initial Sales Encounter,' Journal of Marketing Theory and Practice, Vol. 16, No. 1, Winter, 2008, pp. 27-39 https://doi.org/10.2753/MTP1069-6679160102