Journal of the Korean Operations Research and Management Science Society (한국경영과학회지)

The Korean Operations Research and Management Science Society (한국경영과학회)
권호 표지

The Weights Analysis of Evaluation Areas and Items for the Informatization Program by means of the AHP

AHP기법을 이용한 정보화지원사업 평가영역 및 평가항목별 가중치 분석

  • 김상훈 (광운대학교 경영정보학과) ;
  • 최점기 (광운대학교 디지털경영연구소)
  • Published : 2007.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study focuses on establishing theoretically-reasonable framework of evaluation areas and items for the informatization program and analyzing the weights for each area and item by means of the AHP. To obtain the goal of this research, firstly, based on broadly reviewing previous literature and logical reasoning, the evaluation criteria were Identified and conceptualized, which were 3 evaluation phases, 5 evaluation areas, and 22 evaluation items. Secondly, The data used for calculating the weight values for the evaluation criteria were collected from 48 academic and practical experts in the field of the informatization program promotion using internet survey. Thirdly, the relative weights among evaluation phases, evaluation areas, and its items were derived by AHP analysis. The findings of this study are thought not only to be useful as a practical guideline in performing evaluating the informatization program but also to provide significant basis for constructing the theoretical framework of evaluating method and management of the informatization program.

Keywords

References

  1. 김기환, '정보화사업 타당성분석제도의 개선방향 모색 : 공공분야 타당성분석제도들의 비교를 중심으로', 정보화정책, 제12권, 제1호(2005), pp.59-77
  2. 김준한, '중앙정부의 정보화 평가체계 정립', 한국행정학보, 제36권, 제4호(2002), pp.1-20
  3. 김희철, 이대용, 'ERP 시스템 주성공요인에 따른 도입특성에 대한 연구', 한국정보전략학회 1999 추계공동학술대회 논문집, (1999), pp.345-353
  4. 노미현, 'ERP 시스템의 구현성공과 도입성과에 관한 연구', 중소기업연구, 제26권, 제1호(2004), pp.3-26
  5. 산업자원부, 중소기업진흥공단, 중소기업 IT화 사업계획, 2002
  6. 심상천, 김용겸, 'AHP 기업을 이용한 멀티미디어 저작도구 평가 및 선정에 관한 연구', 경영과학, 제21권, 제2호(2004), pp.191-213
  7. 안봉근, 주기중, 권해익, '포괄적인 정보시스템 성과평가모형에 관한 연구', 경영과학, 제21권, 제2호(2004), pp.111-122
  8. 양재진, 정명주, 정진우, '공공정보화사업의 사전평가 모형 구상 : 예산과의 연계와 사업 실효성 확보방안을 중심으로', 정보화정책, 제10권 제3호(2003), pp.156-177
  9. 오철호, 정홍원, '정보화사업의 사전평가 모형과 방법론 탐색 : 하나의 가설', 한국정책분석평가학회보, 제12권, 제2호(2002), pp.235-266
  10. 윤종수, 한경수, 한재민, '조직성숙수준에 따른 BPR의 주요성공요인과 성과간의 관련성 연구', 경영정보학연구, 제7권, 제2호(1997), pp.103-135
  11. 이상천, 홍정완, '정보화 효과지표의 업종별 분석', 산업공학, 제14권, 제4호(2001), pp.421-428
  12. 이재남, 김영걸, '정보시스템 아웃소싱의 성공을 위한 인과모형에 관한 연구 : 구조방정식 모형 접근방법', 경영학연구, 제28권, 제3호(1999), pp.799-822
  13. 이종호, 주상호, 'ERP 시스템 도입요인과 성과변수에 관한 연구', 생산성논집(구생산성연구), 제16권, 제2호(2002), pp.95-116
  14. 이주헌, 고형대, '소프트웨어 프로젝트 관리의 체계', 정보처리학회지, 제1권, 제3호(1994), pp.7-14
  15. 장경서, 서길수, 이문봉, 'ERP 시스템 구현 핵심성공요인에 관한 탐색적 연구.' Information Systems Review, 제2권, 제2호(2000), pp.255-281
  16. 정보통신정책연구원, 전자정부사업 성과평가모델 연구, 2003
  17. 정보화추진위원회, 국가정보화 평가시행계획, 2005
  18. 정승렬, 정성현, 배준범, '리엔지니어링 성공요인의 이원론적 분석', 경영정보학연구, 제11권, 제2호(2001). pp.205-221
  19. 정해용, 김상훈, '공공정보화사업 추진단계별 평가항목 개발 : 문화정보화사업을 중심으로', 정보화정책, 제11권, 제1호(2004), pp.106-125
  20. 조근태, 조용곤, 강현수, 계층분석적 의사결정, 동현출판사, 2003
  21. 조성훈, 김태성, 이영찬, 'Compatibility를 이용한 다수 전문가의 가중치 종합화에 관한 연구', 한국경영과학회지, 제23권, 제4호(1998), pp.131-140
  22. 중소기업청, 중소기업정보화지원사업 추진계획, 2005
  23. 최영훈, '사전 . 사후평가의 장단점과 통합적 활용방안', 한국정책분석평가학회 2001 추계학술대회 발표논문집, 2001
  24. 한국개발연구원, 다기준분석 방안 연구, 2000
  25. 한국개발연구원, 공공부문의 성과관리, 2004
  26. 한국전산원, 정보화사업평가편람, 1997
  27. 한국전산원, 국가정보화평가 발전방안, 1999
  28. 한국전산원, 정보화사업의 경제적 효과분석에 관한 연구, 1999
  29. 한국전산원, 정보화사업 사전타당성분석 방법론 연구, 2004
  30. Baily, J.E. and S.W. Pearson, 'Development of a Tool for Measuring and Analyzing Computer User Satisfaction,' Management Science, Vol.29, No.5(1983), pp.530-545 https://doi.org/10.1287/mnsc.29.5.530
  31. Bakos, J.Y. and C.F. Kemerer, 'Recent Applications of Economic Theory in Informations Technology Research,' Decision Support Systems, Vol.8(1992), pp.365-386 https://doi.org/10.1016/0167-9236(92)90024-J
  32. DeLone, W.H. and E.R. McLean, 'Information Systems Success : The Quest for the Dependent Variable,' Information Systems Research, Vol.3, No.1(1992), pp.60-95 https://doi.org/10.1287/isre.3.1.60
  33. DeLone, W.H. and E.R McLean, 'The DeLone and McLean-Model of Information Systems Success: A Ten-Year Update,' Journal of Management Information Systems, Vol.19, No.4(2003), pp.9-30 https://doi.org/10.1080/07421222.2003.11045748
  34. Dick, A.S. and K. Basu, 'Customer Loyalty : Toward an Integrated Conceptual Framework,' Academy of Marketing Science Journal, Vol.22, No.2(1994), pp.99-1l3 https://doi.org/10.1177/0092070394222001
  35. Dobbins, J,H. and R.G. Donnely, 'Summary Research Report on Critical Success Factors in Federal Government Program Management,' Acquisition Review Quarterly, Vol.5, No.1(1995), pp.61-82
  36. Dodd, F,J., H.A. Donegan, and T.B. McMaster, 'A Statistical Approach to Consistency in AHP,' Mathematical Computing Modeling, Vol.18, No.6(1993), pp.19-22
  37. Doll, W.J, and G. Torkzadeh, 'A Discrepancy Model of End-User Computing Involvement,' Management Science, Vol.35, No.10(1989), pp.1151-1171 https://doi.org/10.1287/mnsc.35.10.1151
  38. Field, R, 'When Bad Things Happen to Good Project,' CIO, Vol.15(1997), pp.55-62
  39. Flynn, N., 'Performance Measurement in Public Sector Services,' Policy and Politics, Vol.14, No.3(1986), pp.389-404 https://doi.org/10.1332/030557386782628172
  40. Fornell, C., M.D. Johnson, E.W. Anderson, J,S. Cha, and B.E. Bryand, 'The American Customer Satisfaction Index: Nature, Purpose, and Findings,' Journal of Marketing, Vol.60, No.4(1996), pp.7-18 https://doi.org/10.2307/1251898
  41. General Services Administration(GSA), Performance- Based Management: Eight Steps To Develop and Use Information Technology Performance Measures Effectively, 1997
  42. Grover, V., S.R. Jeong, and A.H. Segars, 'Information Systems Effectiveness : The Construct Space and Pattern of Application,' Information & Management, Vol.31 (1996), pp.177-191 https://doi.org/10.1016/S0378-7206(96)01079-8
  43. Hamilton, S. and N.L. Chervany, 'Evaliating Information System Effectiveness-Part : Comparing Evaluation Approaches,' MIS Quarterly, Vol.5, No.3(1981), pp.55-69 https://doi.org/10.2307/249291
  44. Heatley, J., R. Agarwal and M. Tanniru, 'An Evaluation of an Innovative Information Technology-the Case of Carrier EXPERT,' Journal of Strategic Information Systems, Vol.4, No.3(1995), pp.255-277 https://doi.org/10.1016/0963-8687(95)96805-I
  45. Ives, B. and M.H. Olson, 'User Involvement and MIS Success: A Review Research,' Management Science, Vol.30, No.5(1984), pp.586-603 https://doi.org/10.1287/mnsc.30.5.586
  46. Jurison, J., 'Software Project Management : The Manager's View,' Communications of AIS, Vol.2, No.17(1999), pp.3-12
  47. Kettinger, W.J. and C.C. Lee, 'Perceived Service Quality and User Satisfaction with the Information Services Function,' Decision Sciences, Vol. 25, No.5-6(1994), pp.727-766
  48. Levitt, M. and M. Joyce, The Growth and Efficiency of Public Spending, Cambridge University Press, Cambridge, 1987
  49. Marchand, D.A., W.J. Kettinger and J.D. Rollins, 'Information Orientation: People, Technology and the Bottom Line,' Sloan Management Review, Vol.41, No.4(2000), pp.69-80
  50. Myers, B.L., L.A. Kappelman, and V.R. Prybutok, 'A Comprehensive Model for Assessing the Quality and Productivity of the information Systems Function: Toward a Theory for information Systems Assessment,' Information Resources management Journal, Vol.10, No.1(1997), pp.6-25 https://doi.org/10.4018/irmj.1997010101
  51. NTIA(National Telecommunications and Information Administration), Technology Opportunities Program, 2001
  52. Pinto, J,K. and D.P. Slevin, 'Critical Factors in Successful Project Implementation,' IEEE Transactions on Engineering Management, Vol.EM-34, No.1(1987), pp.22-27 https://doi.org/10.1109/TEM.1987.6498856
  53. Pitt, L.F., RT. Watson, and C.B. Kavan, 'Service Quality: A Measure of Information Systems Effectiveness,' MIS Quarterly, Vol.19, No.2(1995), pp.173-187 https://doi.org/10.2307/249687
  54. Ross, J.W, C.M. Beath, and D.L. Goodhue, 'Develop Long-Term Competitiveness Through IT Assets,' Sloan Management Review, Vol.38, No.1(1996), pp.31-42
  55. Saaty, T.L., The AHP : Planning, Priority Setting, Resource Allocation, McGraw-Hill, New York, 1980
  56. Saaty, T.L., 'Priority Setting in complex problems,' IEEE Transactions on Engineering Management, Vol.EM-30, No.3(1983), pp.140-155 https://doi.org/10.1109/TEM.1983.6448606
  57. Saaty, T.L., Decison Making with Dependence and Feedback: The Analytic Network Process, RWS Publications, Pittsburgh, 1996
  58. Scott, J., 'The Measurement of Information Systems Effectiveness: Evaluating a Measuring Instrument,' Proceedings of the 15th International conference on Information Systems, Vancouver, British Columbia, 1994, pp.111-128
  59. Stevens, F., F. Lawrenz, and L. Sharp, User-Friendly Handbook for Project Evaluation : Science, Mathematics, Engineering and Technology Education, National Science Foundation, Arlington, 1993
  60. Swiss, J.E., 'Performance Monitoring Systems,' in Accountability for Performance, David Ammons(ed.), ICMA, Washington, D.C., 1995
  61. Watson, R.T., L.F. Pitt, and C.B. Kavan, 'Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies,' MIS Quarterly, Vol.22, No.1 (1998), pp.61-79 https://doi.org/10.2307/249678
  62. Zeithaml, VA, L.L. Berry, and A. Parasuraman, 'The Behavioral Consequences of Service Quality,' Journal of Marketing, Vol.60, No.2(1996), pp.31-46