International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Detecting Fake Reviews: Exploring the Linguistic Characteristics by Computerized Text Analysis

  • Moon-Yong Kim (College of Business, Hankuk University of Foreign Studies)
  • Received : 2024.06.28
  • Accepted : 2024.07.11
  • Published : 2024.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Online consumer reviews have become the most important basis for online shopping and product sales. Fake reviews are generated to boost sales because online consumer reviews play a vital role in consumers' decision making. The prevalence of fake reviews violates the regulations of the online business environment and misleads consumers in decision making. Thus, the present research investigates the effects of reviews' linguistic characteristics (i.e., analytical thinking, authenticity) on review fakeness. Specifically, this research examines whether (1) the level of analytical thinking is lower for fake (vs. genuine) reviews (hypothesis 1) and (2) the level of authenticity is lower for fake (vs. genuine) reviews (hypothesis 2). This research analyzed user-generated hotel reviews (genuine reviews, fake reviews) collected from MTurk. Linguistic Inquiry and Word Count (LIWC) 2022 was adopted to code review contents, and the hypotheses were tested using logistic regression. Consistent with the hypotheses 1 and 2, the results indicate that (1) analyticial thinking is negatively associated with review fakeness; and (2) authenticity is negatively associated with review fakeness. The findings provide important implications to identify fake reviews based on linguistic characteristics.

Keywords

Acknowledgement

This work was supported by Hankuk University of Foreign Studies Research Fund of 2023.

References

  1. J. Chevalier and D. Mayzlin, "The Effect of Word of Mouth on Sales: Online Book Reviews," Journal of Marketing Research, Vol. 43, No. 3, pp. 345-354, August 2006. DOI: https://doi.org/10.1509/jmkr.43.3.345
  2. Y. Liu, "Word of Mouth for Movies: Its Dynamics and Impact on Box Office Revenue," Journal of Marketing, Vol. 70, No. 3, pp. 74-89, July 2006. DOI: https://doi.org/10.1509/jmkg.70.3.074
  3. L. Kwok, K.L. Xie, and T. Richards, "Thematic Framework of Online Review Research," International Journal of Contemporary Hospitality Management, Vol. 29, No. 1, pp. 307-354, January 2017. DOI: https://doi.org/10.1108/IJCHM-11-2015-0664
  4. I.C.C. Chan, L.W. Lam, C.W. Chow, L.H.N. Fong, and R. Law, "The Effect of Online Reviews on Hotel Booking Intention: The Role of Reader-Reviewer Similarity," International Journal of Hospitality Management, Vol. 66, pp. 54-65, September 2017. DOI: https://doi.org/10.1016/j.ijhm.2017.06.007
  5. M. Schuckert, X. Liu, and R. Law, "Hospitality and Tourism Online Reviews: Recent Trends and Future Directions," Journal of Travel and Tourism Marketing, Vol. 32, No. 5, pp. 608-621, August 2015. DOI: https://doi.org/10.1080/10548408.2014.933154
  6. Y. Wu, E.W.T. Ngai, P. Wu, and C. Wu, "Fake Online Reviews: Literature Review, Synthesis and Directions for Future Research," Decision Support Systems, Vol. 132, 113280, May 2020. DOI: https://doi.org/10.1016/j.dss.2020.113280
  7. Y. Xu, Z. Zhang, R. Law, and Z. Zhang, "Effects of Online Reviews and Managerial Responses from a Review Manipulation Perspective," Current Issues in Tourism, Vol. 23, No. 17, pp. 2207-2222, 2020. DOI: https://doi.org/10.1080/13683500.2019.1626814
  8. L. Li, K.Y. Lee, M. Lee, and S.B. Yang, "Unveiling the Cloak of Deviance: Linguistic Cues for Psychological Processes in Fake Online Reviews," International Journal of Hospitality Management, Vol. 87, 102468, May 2020. DOI: https://doi.org/10.1016/j.ijhm.2020.102468
  9. M. Luca and G. Zervas, "Fake It Till You Make It: Reputation, Competition and Yelp Review Fraud," Management Science, Vol. 62, No. 12, pp. 3412-3427, January 2016. DOI: https://doi.org/10.1287/mnsc.2015.2304
  10. U. Chakraborty, "Perceived Credibility of Online Hotel Reviews and Its Impact on Hotel Booking Intentions," International Journal of Contemporary Hospitality Management, Vol. 31, No. 9, pp. 3465-3483, August 2019. DOI: https://doi.org/10.1108/IJCHM-11-2018-0928
  11. R. Filieri, F. Acikgoz, V. Ndou, and Y. Dwivedi, "Is TripAdvisor Still Relevant? The Influence of Review Credibility, Review Usefulness and Ease of Use on Consumers' Continuance Intention," International Journal of Contemporary Hospitality Management, Vol. 33, No. 1, pp. 199-223, January 2021. DOI: https://doi.org/10.1108/IJCHM-05-2020-0402
  12. R. Law, D. Leung, and I.C.C. Chan, "Progression and Development of Information and Communication Technology Research in Hospitality and Tourism: A State-of-the-Art Review," International Journal of Contemporary Hospitality Management, Vol. 32, No. 2, pp. 511-534, February 2020. DOI: https://doi.org/10.1108/IJCHM-07-2018-0586
  13. D. Plotkina, A. Munzel, and J. Pallud, "Illusions of Truth-Experimental Insights into Human and Algorithmic Detections of Fake Online Reviews," Journal of Business Research, Vol. 109, pp. 511-523, March 2020. DOI: https://doi.org/10.1016/j.jbusres.2018.12.009
  14. J.W. Pennebaker, R. Boyd, K. Jordan, and K. Blackburn, The Development and Psychometric Properties of LIWC 2015, 2015.
  15. Y.R. Tausczik and J.W. Pennebaker, "The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods," Journal of Language and Social Psychology, Vol. 29, No. 1, pp. 24-54, 2010. DOI: https://doi.org/10.1177/0261927X09351676
  16. J.W. Pennebaker, M.R. Mehl, and K.G. Niederhoffer, "Psychological Aspects of Natural Language Use: Our Words, Our Selves," Annual Review of Psychology, Vol. 54, pp. 547-577, 2003. DOI: 10.1146/annurev.psych.54.101601.145041
  17. C. Ferreira, J. Robertson, R. Chohan, L. Pitt, and T. Foster, "The Writing is on the Wall: Predicting Customers' Evaluation of Customer-Firm Interactions Using Computerized Text Analysis," Journal of Service Theory and Practice, Vol. 33, No. 2, pp. 309-327, February 2023. DOI: https://doi.org/10.1108/JSTP-04-2022-0100
  18. R.L. Boyd, A. Ashokkumar, S. Seraj, and J.W. Pennebaker, The Development and Psychometric Properties of LIWC-22, University of Texas at Austin, 2022.
  19. T. Ngo-Ye, A. Sinha, and A. Sen, "Predicting the Helpfulness of Online Reviews Using a Scripts-Enriched Text Regression Model," Expert Systems with Applications, Vol. 71, pp. 98-110, April 2017. DOI: https://doi.org/10.1016/j.eswa.2016.11.029
  20. A. Agnihotri and S. Bhattacharya, "Online Review Helpfulness: Role of Qualitative Factors," Psychology & Marketing, Vol. 33, No. 11, pp. 1006-1017, October 2016. DOI: https://doi.org/10.1002/mar.20934
  21. A. Humphreys and R. Wang, "Automated Text Analysis for Consumer Research," Journal of Consumer Research, Vol. 44, No. 6, pp. 1274-1306, April 2018. DOI: https://doi.org/10.1093/jcr/ucx104
  22. B. Balducci and D. Marinova, "Unstructured Data in Marketing", Journal of the Academy of Marketing Science, Vol. 46, pp. 557-590, June 2018. DOI: https://doi.org/10.1007/s11747-018-0581-x
  23. C. Pitt, C. M. Mulvey, and J. Kietzmann, "Quantitative Insights from Online Qualitative Data: An Example from the Healthcare Sector," Psychology & Marketing, Vol. 35, No. 12, pp. 1010-1017, November 2018. DOI: https://doi.org/10.1002/mar.21152
  24. J. Robertson, C. Ferreira, and J. Paschen, "Reading Between the Lines: Understanding Customer Experience with Disruptive Technology through Online Reviews," Australasian Marketing Journal, Vol. 29, No. 3, pp. 215-224, March 2021. DOI: https://doi.org/10.1177/1839334921999487
  25. J.W. Pennebaker, C.K. Chung, J. Frazee, G.M. Lavergne, and D.I. Beaver, "When Small Words Foretell Academic Success: The Case of College Admissions Essays," PloS One, Vol. 9, No. 12, 110, December 2014. DOI: https://doi.org/10.1371/journal.pone.0115844
  26. K. Jordan, J. Sterling, J.W. Pennebaker, and R. Boyd, "Examining Long-Term Trends in Politics and Culture through Language of Political Leaders and Cultural Institutions," Psychological and Cognitive Sciences, Vol. 116, No. 9, pp. 3476-3481, February 2019. DOI: 10.1073/pnas.1811987116
  27. U. Zhou, J.K. Burgoon, D.P. Twitchell, T. Qin, and J.F. Jr. Nunamaker, "A Comparison of Classification Methods for Predicting Deception in Computer-Mediated Communication," Journal of Management Information Systems, Vol. 20, No. 4, pp. 139-165, 2004. DOI: https://doi.org/10.1080/07421222.2004.11045779
  28. J.K. Burgoon, D.B. Buller, A.S. Ebesu, C.H. White, and P.A. Rockwell, "Testing Interpersonal Deception Theory: Effects of Suspicion on Communication Behaviors and Perceptions," Communication Theory, Vol. 6, No. 3, pp. 243-267, August 1996. DOI: https://doi.org/10.1111/j.1468-2885.1996.tb00128.x
  29. J.R. Carlson, J.F. George, J.K. Burgoon, M. Adkins, and C.H. White, "Deception in Computer-Mediated Communication," Group Decision and Negotiation, Vol. 13, No. 1, pp. 5-28, January 2004. DOI: https://doi.org/10.1023/B:GRUP.0000011942.31158.d8
  30. U. Chakraborty and S. Bhat, "The Effects of Credible Online Reviews on Brand Equity Dimensions and Its Consequence on Consumer Behavior," Journal of Promotion Management, Vol. 24, No. 1, pp. 57-82, 2018. DOI: https://doi.org/10.1080/10496491.2017.1346541
  31. M.L. Newman, J.W. Pennebaker, D.S. Berry, and J.M. Richards, "Lying Words: Predicting Deception from Linguistic Style," Personality and Social Psychology Bulletin, Vol. 29, No. 5, pp. 665-675, May 2003. DOI: https://doi.org/10.1177/0146167203029005010
  32. S. Chaiken, A. Liberman, and A.H. Eagly, "Heuristic and Systematic Information Processing Within and Beyond the Persuasion Context," Unintended Thought, Vol. 212, pp. 212-252, 1989.
  33. S. Chen and S. Chaiken, "The Heuristic-Systematic Model in Its Broader Context," Dual-Process Theories in Social Psychology, Vol. 15, pp. 73-96, 1999.
  34. D. Fernandes, "The 1/N Rule Revisited: Heterogeneity in the Naive Diversification Bias," International Journal of Research in Marketing, Vol. 30, No. 3, pp. 310-313, September 2013. DOI: https://doi.org/10.1016/j.ijresmar.2013.04.001
  35. S. Yang and M. Lynn, "More Evidence Challenging the Robustness and Usefulness of the Attraction Effect," Journal of Marketing Research, Vol. 51, No. 4, pp. 508-513, 2014. DOI: https://doi.org/10.1509/jmr.14.0020
  36. J. Chandler, P. Mueller, and G. Paolacci, "Nonnaivete among Amazon Mechanical Turk Workers: Consequences and Solutions for Behavioral Researchers," Behavior Research Methods, Vol. 46, pp. 112-130, 2014. DOI: https://doi.org/10.3758/s13428-013-0365-7
  37. J. Kees, C. Berry, S. Burton, and K. Sheehan, "An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk," Journal of Advertising, Vol. 46, No. 1, pp. 141-155, 2017. DOI: https://doi.org/10.1080/00913367.2016.1269304
  38. S.M. Smith, M. Scott, C.A. Roster, L.L. Golden, and G.S. Albaum, "A Multi-Group Analysis of Online Survey Respondent Data Quality: Comparing a Regular USA Consumer Panel to MTurk Samples," Journal of Business Research, Vol. 69, No. 8, pp. 3139-3148, August 2016. DOI: https://doi.org/10.1016/j.jbusres.2015.12.002
  39. S. Moon, M-Y. Kim, and D. Iacobucci, "Content Analysis of Fake Consumer Reviews by Survey-Based Text Categorization," International Journal of Research in Marketing, Vol. 38, No. 2, pp. 343-364, June 2021. DOI: https://doi.org/10.1016/j.ijresmar.2020.08.001
  40. M. Lee, S.A. Lee, and Y. Koh, "Multisensory Experience for Enhancing Hotel Guest Experience: Empirical Evidence from Big Data Analytics," International Journal of Contemporary Hospitality Management, Vol. 31, No. 11, pp. 4313-4337, July 2019. DOI: https://doi.org/10.1108/IJCHM-03-2018-0263
  41. S.W. Litvin and R.N. Sobel, "Organic versus Solicited Hotel Tripadvisor Reviews: Measuring Their Respective Characteristics," Cornell Hospitality Quarterly, Vol. 60, No. 4, pp. 370-377, 2019. DOI: https://doi.org/10.1177/19389655188112
  42. Z. Xiang, Q. Du, Y. Ma, and W. Fan, "A Comparative Analysis of Major Online Review Platforms: Implications for Social Media Analytics in Hospitality and Tourism," Tourism Management, Vol. 58, pp. 51-65, February 2017. DOI: https://doi.org/10.1016/j.tourman.2016.10.001
  43. J. Zhan, H.T. Loh, and Y. Liu, "Gather Customer Concerns from Online Product Reviews-A Text Summarization Approach," Expert Systems with Applications, Vol. 36, No. 2, pp. 2107-2115, March 2009. DOI: https://doi.org/10.1016/j.eswa.2007.12.039
  44. J. Buschken and G.M. Allenby, "Sentence-Based Text Analysis for Customer Reviews," Marketing Science, Vol. 35, No. 6, pp. 953-975, July 2016. DOI: https://doi.org/10.1287/mksc.2016.0993
  45. S. Tirunillai and G.J. Tellis, "Mining Marketing Meaning from Online Chatter: Strategic Brand Analysis of Big Data Using Latent Dirichlet Allocation," Journal of Marketing Research, Vol. 51, No. 4, pp. 463-479, 2014. DOI: https://doi.org/10.1509/jmr.12.0106
  46. M. Yu, M. Cheng, L. Yang, and Z. Yu, "Hotel Guest Satisfaction during COVID-19 Outbreak: The Moderating Role of Crisis Response Strategy," Tourism Management, Vol. 93, 104618, December 2022. DOI: https://doi.org/10.1016/j.tourman.2022.104618
  47. V. Manchaiah, D. Swanepoel, and R. Bennett, "Online Consumer Reviews on Hearing Health Care Services: A Textual Analysis Approach to Examine Psychologically Meaningful Language Dimensions," American Journal of Audiology, Vol. 30, No. 3, pp. 669-675, September 2021. DOI: https://doi.org/10.1044/2021_AJA-20-00223