Journal of Intelligence and Information Systems (지능정보연구)

Korea Intelligent Information System Society (한국지능정보시스템학회)
권호 표지
DOI QR코드

DOI QR Code

What factors drive AI project success?

무엇이 AI 프로젝트를 성공적으로 이끄는가?

  • KyeSook Kim (Graduate School of Business IT, Kookmin University) ;
  • Hyunchul Ahn (Graduate School of Business IT, Kookmin University)
  • 김계숙 (국민대학교 비즈니스IT전문대학원) ;
  • 안현철 (국민대학교 비즈니스IT전문대학원)
  • Received : 2023.02.28
  • Accepted : 2023.03.20
  • Published : 2023.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper aims to derive success factors that successfully lead an artificial intelligence (AI) project and prioritize importance. To this end, we first reviewed prior related studies to select success factors and finally derived 17 factors through expert interviews. Then, we developed a hierarchical model based on the TOE framework. With a hierarchical model, a survey was conducted on experts from AI-using companies and experts from supplier companies that support AI advice and technologies, platforms, and applications and analyzed using AHP methods. As a result of the analysis, organizational and technical factors are more important than environmental factors, but organizational factors are a little more critical. Among the organizational factors, strategic/clear business needs, AI implementation/utilization capabilities, and collaboration/communication between departments were the most important. Among the technical factors, sufficient amount and quality of data for AI learning were derived as the most important factors, followed by IT infrastructure/compatibility. Regarding environmental factors, customer preparation and support for the direct use of AI were essential. Looking at the importance of each 17 individual factors, data availability and quality (0.2245) were the most important, followed by strategy/clear business needs (0.1076) and customer readiness/support (0.0763). These results can guide successful implementation and development for companies considering or implementing AI adoption, service providers supporting AI adoption, and government policymakers seeking to foster the AI industry. In addition, they are expected to contribute to researchers who aim to study AI success models.

본 논문은 인공지능(AI) 프로젝트를 성공적으로 이끄는 주요 요인을 도출하고 중요도의우선순위를 두는 것을 목적으로 한다. 이를 위해 우선 기존 유관 연구들을 검토하여 성공요인을 선정하고, 전문가 인터뷰를 통해 17개 요인을 최종 도출하였다. 이어 TOE 프레임워크를 활용하여 계층 모형을 개발하였다. 이후, AI 활용 기업 소속 전문가와 AI 자문 및 기술, 플랫폼, 어플리케이션을 지원하는 공급기업 소속 전문가를 대상으로 설문 조사를 실시하고, AHP 방법을 활용하여 분석하였다. 분석 결과, 환경적 요인보다 조직적 요인과 기술적 요인이 모두 중요한데, 이 중 조직적 요인이 조금 더 중요한 것으로 나타났다. 조직적 요인 중에서는 전략/명확한 비즈니스 니즈와 AI 구현/활용 역량, 그리고 부서 간 협업/커뮤니케이션이 가장 중요한 요인으로 나타났다. 기술적 요인 중에서는 AI 학습을 위한 충분한 데이터 양과 데이터 품질이 가장 중요한 요인으로 도출되었으며, 이어서 IT 인프라/호환성이 중요하게 응답되었다. 환경적 요인에서는 AI를 직접 사용할 고객의 준비와 지지가 중요한 요인으로 나타났다. 각 17개 개별요인의 중요도를 살펴보면 데이터의 가용성과 품질(0.2245)이 가장 중요하고, 이어 전략/명확한 비즈니스 니즈(0.1076), 고객준비/지지(0.0763) 순으로 중요한 것으로 분석되었다. 이러한 결과는 AI 도입을 검토 중이거나 실행중인 기업, AI 도입을 지원하는 서비스 공급기업, AI 산업을 육성하고자 하는 정부 정책 입안자들에게 성공적인 실행, 육성을 위한 가이드로 활용될 수 있다. 또한 AI 프로젝트의 성공 모델을 연구하고자 하는 연구자들에게도 기여할 것으로 기대된다.

Keywords

References

  1. 고병찬. (2023년2월28일). 국민대, 국내 대학 최초 '챗GPT' 윤리 강령 선포. 한겨레. https://www.hani.co.kr/arti/society/society_general/1081625.html 
  2. 과학기술정보통신부. (2020년5월28일). 인공지능기술(서비스) 이용 의향. 2.15. 2023, https://kosis.kr/statHtml/statHtml.do?orgId=127&tblId=DT_120008N_73&conn_path=I3 
  3. 김수영. (2023년 1월 26일). AI를 일상으로... 차세대 AI 개발에 5년간 2600억 투입키로. 노컷뉴스. https://www.nocutnews.co.kr/news/5885212 
  4. 김주연. (2023년 3월 17일). 고려대, 첫 '챗GPT 가이드라인', 인터뷰, 설문 등 경험, 과제 담아야. 서울신문. https://www.seoul.co.kr/news/newsView.php?id=20230317010008 
  5. 김하영, 허정윤, 권호창. (2022). 인공지능 기반 금융서비스의 공정성 확보를 위한 체크리스트 제안: 인공지능 기반 개인신용평가를 중심으로. 지능정보연구, 28(3), 259-278.  https://doi.org/10.13088/JIIS.2022.28.3.259
  6. 박경문, 최명범. (2002). 합병기업의 조직문화가 조직유효성과 노사관계에 미치는 영향. 인적자원관리연구, 4(4), 215-243. 
  7. 박소정, 박지윤. (2017). 인슈어테크 혁명: 현황 점검 및 과제 고찰. 보험연구원, 11, 1-170. 
  8. 산업통상자원부. (2023년 1월 13일). 산업 혁신의 성공방정식, 인공지능(AI) 중심으로 새로 쓴다. 산업통상자원부. 02.12, 2023, https://www.motie.go.kr/motie/ne/presse/press2/bbs/bbsView.do?bbs_seq_n=166656&bbs_cd_n=81¤tPage=1&search_key_n=&cate_n=1&dept_v=&search_val_v= 
  9. 이재원, 오상진. (2020). 인공지능 기술 기반 인슈어테크와 디지털보험플랫폼 성공사례 분석: 중국 평안보험그룹을 중심으로. 지능정보연구, 26(3), 71-90.  https://doi.org/10.13088/JIIS.2020.26.3.071
  10. 이창효. (2000). 집단의사결정론. 세종출판사. 
  11. 옥기원. (2023년 3월 2일). 카카오, 국내 최초 기술윤리위원회 출범, 알고리즘 투명성 강화. 한겨레. https://www.hani.co.kr/arti/economy/it/1052278.html 
  12. 정령, 유훈식. (2017). 인공지능 제품의 사용자 수용도에 대한 조사 연구. 한국지능정보시스템학회 추계학술대회. 
  13. 최새솔, 주보라, 연승준. (2022). 인공지능(AI) 산업의 VC 투자 동향과 시사점, 
  14. 한국전자통신연구원. 전자통신동향분석 제37권 2022년 12월. 1-10. 
  15. 최은주, 이준영, 한인구. (2020). 딥러닝 오픈소스 프레임워크의 사례연구를 통한 도입 전략 도출. 지능정보연구. 26(4). 27~65.  https://doi.org/10.13088/JIIS.2020.26.4.027
  16. 한국IDC. (2022). 국내 인공지능(AI) 시장 전망 2021-2025. 한국IDC. 
  17. Abudayyeh, O., Zidan, S. J., Yehia, S., & Randolph, D. (2007). Hybrid prequalificationbased, innovative contracting model using AHP. Journal of Management in Engineering, 23(2), 88-96. 
  18. Alsheibani, S., Messom, C., & Cheung, Y. (2020). Re-Thinking the Competitive Landscape of Artificial Intelligence. In Proceedings of the Hawaii International Conference on System Sciences (HICSS) (pp. 5861-5870). 
  19. Andrew, Ng. (2019). How to choose your first AI project. Harvard Business Review, March-April 2019. 
  20. Arnott, D. (2008). Success factors for data warehouse and business intelligence systems. In Proceedings of the 19th Australasian conference on information systems, Christchurch (pp. 55-65). 
  21. Baker, J. (2012). The Technology-Organization-Environment Framework. Integrated Series in Information Systems, Vol. 28. Springer, New York. 
  22. Bauer, M., van Dinther, C., & Kiefer, D. (2020). Machine learning in SME: An empirical study on enablers and success factors. In Proceedings of the Americas conference on information systems (pp. 1-10). 
  23. Bergstein, B. (2019). Can AI pass the smell test? MIT Technology Review, 122, 82-86. 
  24. Bhattacherjee, A., & Hikmet, N. (2007). Physicians' resistance toward healthcare information technology: A theoretical model and empirical test. European Journal of Information Systems, 16(6), 725-737.  https://doi.org/10.1057/palgrave.ejis.3000717
  25. Brachman, R. J. 2006. (AA)AI More than the Sum of Its Parts. AI Magazine (27:4), pp. 19-19. 
  26. Broda, E. (2019). The most difficult part about AI/Machine learning occurs after the model is created. Towards Data Science. Retrieved from https://towardsdatascience.com/the-mostdifficult-part-about-ai-machine-learning-occurs-after-the-model-is-created-b585480c6918 
  27. Chatterjee, D., Grewal, R., & Sambamurthy, V. (2002). Shaping up for e-commerce: Institutional enablers of the organizational assimilation of Web technologies. MIS Quarterly, 26(2), 65-89.  https://doi.org/10.2307/4132321
  28. Chau, P. Y. K., & Hu, P. J. (2002). Examining a model of information technology acceptance by individual professionals: An exploratory study. Journal of Management Information Systems, 18(4), 191-230. 
  29. Chui, M., & Malhotra, S. (2018). AI adoption advances, but foundational barriers remain. Mckinsey and company. 
  30. Darko, A., Chan, A. P. C., Ameyaw, E. E., Owusu, E. K., Parn, E., & Edwards, D. J. (2019). Review of application of analytic hierarchy process (AHP) in construction. International Journal of Construction Management, 19(5), 436-452.  https://doi.org/10.1080/15623599.2018.1452098
  31. Demlehner, Q., & Laumer, S. (2020). Shall We Use It or Not? Explaining the Adoption of Artificial Intelligence for Car Manufacturing Purposes. European Conference on Information Systems (ECIS). 
  32. El-Adaileh, N. A., & Foster, S. (2019). Successful business intelligence implementation: A systematic literature review. Journal of Work-Applied Management, 11(2), 121-132. 
  33. Faraj, S., Pachidi, S., & Sayegh, K. (2018). Working and organizing in the age of the learning algorithm. Information and Organization, 28(1), 62-70.  https://doi.org/10.1016/j.infoandorg.2018.02.005
  34. Fortune Business Insight. (2022, September 13). AI market size to reach USD 1394.30 billion by 2029. 
  35. Gasser, U., & Almeida, V. A. F. (2017). A layered model for AI governance. IEEE Internet Computing, 21(6), 58-62. 
  36. Goasduff, L. (2019). 3 barriers to AI adoption. Gartner. 
  37. Hamm, P., & Klesel, M. (2021). Success Factors for the Adoption of Artificial Intelligence in Organizations: A Literature Review. In AMCIS 2021 Proceedings. 10. 
  38. Jurison, J. (1999). Software project management: The manager's view. Communications of the Association for Information Systems, 2, 1-33. https://doi.org/10.17705/1CAIS.00217 
  39. Kordon, A. (2020). Applied artificial intelligence-based systems as competitive advantage. In IEEE 10th International Conference on Intelligent Systems (IS) (pp. 1541-1672). Varna, Bulgaria. 
  40. Kruse, L., Wunderlich, N., & Beck, R. (2019). Artificial Intelligence for the Financial Services Industry: What Challenges Organizations to Succeed. In Proceedings of the Hawaii International Conference on System Sciences (HICSS) (pp. 6408-6417). Maui, Hawaii. 
  41. Kuan, K. K. Y., & Chau, P. Y. K. (2001). A Perception-Based Model for EDI Adoption in Small Businesses Using a Technology-Organization-Environment Framework. Information & Management, 38(8), 507-521. https://doi.org/10.1016/S0378-7206(00)00068-8 
  42. Marr, B. (2020). The 4 biggest barriers to AI adoption every business needs to tackle. Forbes. https://www.forbes.com/sites/bernardmarr/2020/01/17/the-4-biggest-barriers-to-ai-adoption-every-business-needs-to-tackle/ 
  43. McCarthy, J., Minsky, M. L., Rochester, N., & Shannon, C. E. (2006). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955. AI Magazine, 27(4), 12-14. 
  44. Merhi, M. I., & Ahluwalia, P. (2019). Examining the impact of deterrence factors and norms on resistance to information systems security. Computers in Human Behavior, 92, 37-46. https://doi.org/10.1016/j.chb.2018.11.035 
  45. Merhi, M. I. (2021a). A process model of artificial intelligence implementation leading to proper decision making. In Conference on e-Business, e-Services and e-Society (pp. 40- 46). Springer, Cham. 
  46. Merhi, M. I. (2021b). Evaluating the critical success factors of data intelligence implementation in the public sector using analytical hierarchy process. Technological Forecasting and Social Change, 173, Article 121180. https://doi.org/10.1016/j.techfore.2021.121180 
  47. Merhi, M. I. (2022). An evaluation of the critical success factors impacting artificial intelligence implementation. International Journal of Information Management, 62, 102545. https://doi.org/10.1016/j.ijinfomgt.2022.102545 
  48. Nasirian, F., Ahmadian, M., & Lee, O.-K. D. (2017). AI-Based Voice Assistant Systems: Evaluating from the Interaction and Trust Perspectives. In Proceedings of the Americas Conference on Information Systems (AMCIS), Boston, United States. 
  49. Parra, C. M., Gupta, M., & Dennehy, D. (2021). Likelihood of questioning AI-based recommendations due to perceived racial/gender bias. IEEE Transactions on Technology and Society. https://doi.org/10.1109/TTS.2021.3120303 
  50. Petter, S., DeLone, W., & McLean, E. R. (2013). Information Systems Success: The Quest for the Independent Variables. Journal of Management Information Systems, 29(4), 7-62. https://doi.org/10.2753/MIS0742-1222290401 
  51. Prove, P. L., Jopp-van Well, E., Stanczus, B., Rieger, J., & Rothschild, M. A. (2019). Automated segmentation of the knee for age assessment in 3D MR images using convolutional neural networks. International Journal of Legal Medicine, 133(4), 1191-1205. https://doi.org/10.1007/s00414-018-1953-y 
  52. Pumplun, L., Tauchert, C., & Heidt, M. (2019). A New Organizational Chassis for Artificial Intelligence - Exploring Organizational Readiness Factors. In Proceedings of European Conference on Information Systems (ECIS). 
  53. Pun, K. F., & Hui, I. K. (2001). An analytical hierarchy process assessment of the ISO 14001 environmental management system. Integrated Manufacturing Systems, 12(5), 333-345. https://doi.org/10.1108/09576060110395876 
  54. Rana, R., Staron, M., Hansson, J., Nilsson, M., and Meding, W. (2014). A Framework for Adoption of Machine Learning in Industry for Software Defect Prediction. In Proceedings of the 9th International Conference on Software Engineering and Applications (ICSOFT-EA) (pp. 383-389). Vienna, Austria. 
  55. Ransbotham, S., Khodabandeh, S., Fehling, R., LaFountain, B., & Kiron, D. (2019). Winning with AI. MIT Sloan Management Review. Retrieved from https://sloanreview.mit.edu/projects/winning-with-ai/ 
  56. Ransbotham, S., Kiron, D., Gerbert, P., & Reeves, M. (2017). Reshaping business with artificial intelligence: Closing the gap between ambition and action. MIT Sloan Management Review, 59(1), n/a-0. https://sloanreview.mit.edu/article/reshaping-business-with-artificial-intelligence/ 
  57. Russell, S., and Norvig, P. (2003). Artificial Intelligence: A Modern Approach. Upper Saddle River, NJ: Pearson. 
  58. Rzepka, C., and Berger, B. (2018). User Interaction with AI-Enabled Systems: A Systematic Review of IS Research. In Proceedings of the International Conference on Information Systems (ICIS). 
  59. Saaty, T. L. (1988). What is the analytic hierarchy process? Mathematical models for decision support. Journal of Mathematical Psychology, 32(1), 109-121. https://doi.org/10.1016/0022-2496(88)90017-1 
  60. Schafer, C., Lemmer, K., Kret, K., Ylinen, M., Mikalef, P., & Niehaves, B. (2021). Truth or Dare? How Can We Influence the Adoption of Artificial Intelligence in Municipalities? In Proceedings of the 54th Hawaii International Conference on System Sciences (HICSS) (pp. 5533-5542). https://doi.org/10.24251/HICSS.2021.678 
  61. Thanki, S., Govindan, K., & Thakkar, J. (2016). An investigation on lean-green implementation practices in Indian SMEs using analytical hierarchy process (AHP) approach. Journal of Cleaner Production, 135, 284-298. https://doi.org/10.1016/j.jclepro.2016.06.098 
  62. Tornatzky, L. G., & Fleischer, M. (1990). The Processes of Technological Innovation. Lexington Books. 
  63. Tractica. (2015). Artificial Intelligence for Enterprise Applications. Retrieved from https://www.tractica.com/report/artificial-intelligence-for-enterprise-applications/ 
  64. Tuner, J. R. (1993). The Handbook of Project-based Management. McGraw Hill. London. 
  65. VentureBeat (2019). Why do 87% of data science projects never make it into production? Retrieved from https://venturebeat.com/ai/why-do-87-of-data-science-projects-never-make-it-into-production/ 
  66. Wirtz, B. W., Weyerer, J. C., & Geyer, C. (2019). Artificial intelligence and the public sector-Applications and challenges. International Journal of Public Administration, 42(7), 596-615. https://doi.org/10.1080/01900692.2019.1570243 
  67. Yeoh, W., & Koronios, A. (2010). Critical success factors for business intelligence systems. Journal of Computer Information Systems, 50(3), 23-32. https://doi.org/10.1080/08874417.2010.11645547 
  68. Zhu, K., Kraemer, K. L., & Dedrick, J. (2004). Information Technology Payoff in E-Business Environments: An International Perspective on Value Creation of E-Business in the Financial Services Industry. Journal of Management Information Systems, 21(1), 17-54. https://doi.org/10.1080/07421222.2004.11045702