A Study on the Evaluation & Selection of Multimedia Authoring Tools using the AHP

AHP 기법을 이용한 멀티미디어 저작도구 평가 및 선정에 관한 연구

  • 심상천 (경원전문대학 이비즈니스과) ;
  • 김용겸 (경원대학교 경영회계학부)
  • Published : 2004.11.01

Abstract

This study addresses the evaluation criteria of multimedia authoring tools(MATs), the way which decision-maker can exclude outlier matrix from group using the concept of the compatibility index, and how AHP can be applied to the selection of MATs in a group decision-making environment. The AHP technique allows an evaluator to quantify the relative importance of elements at each hierarchy and to calculate the composite relative weights for each product(i.e. MATs). This decision process allows setting to priority of the MATs based on the AHP. The results indicated that technical ability of MATs was the most significant factor in affecting their decision, trailed by managerial efficiency and vendor support. To the experts, multimedia data support was the less important than development interface. Also, the results indicated that product A(0.510) was their first choice, trailed by product C(0.286) and B(0.204). Assessing the composite relative weights revealed that expert group's members were consistent with the rankings of decision variables(evaluation criteria variables) statistically in selecting their MATs. Therefore, we believed that expert group's members have achieved sufficient agreement to permit the use of geometric mean to average the group's preference without obscuring the differences of individual opinions.

Keywords

References

  1. 강병서, '인과분석을 위한 연구방법론',개정판,무역경영사,2002
  2. 과학기술처 '소프트웨어 기술성 평가에 대한 고시안',1994
  3. 권철신, 조근태, 'AHP를 이용한 비메모리 반도체칩 제품군 선정에 관한 연구','경영과학‘,제18권,제1호(2001),pp.1-13
  4. 김기석,김진수,김현우,‘BPR 대상프로세스선정을 위한 AHP 적용', ’경영.경제연구‘,부산대학교 경영.경제연구소,제16권,제1호(1997), pp.27-39
  5. 김성철,어하준,‘AHP 가중치 결정에서의 다수 전문가 의견종합 방법’,‘한국경영과학회지’,제19권,제3호(1994),pp.41-51
  6. 김형재, ‘멀티미디어 기본 구성요소 최적화콘텐츠제작 전문기술 연구보고서’,(주)케이아이엠씨,2002
  7. 박철수,한인구,‘회계관리 소프트웨어 팩키지의 품질평가 : 계층분석과정의 적용’, ‘한국경영정보학회 ‘95 추계학술대회 논문집’,1995, pp.919-941
  8. 변대호,'AHP를 이용한 가상쇼핑몰 평가','경영과학',제18권,제1호(2001),p.55-68
  9. 변대호,‘워크플로우 소프트웨어 제품 선정방법 : AHP 접근', '정보시스템 연구',제12권 제1호(2003), pp.145-158
  10. 변대호,‘EIS 소프트웨어 패키지 평가를 위한AHP 모형', ’경영정보학연구‘,제9권, 제3호(1999), pp.75-92
  11. Braxton/Partner,Deloitte/Touche Consulting Group, '멀티미디어 서비스의 전망 : 독일 사례분석',1996, pp.1-11
  12. 산업자원부 한국산업기술재단, '멀티미디어기술로드맵‘, 2002, pp.1-177
  13. 심상천,김용겸,‘AHP 기법을 이용한 멀티미디어 저작도구 평가기준의 중요도 측정’, ‘2003년도 3개 학회 통합 추계학술대회 논문집(한국기업경영학회 등)’, 2003, pp.229-257
  14. 윤용호, ‘디렉터 8’, 베스트북,2001
  15. 윤재곤,‘AHP 기법의 적용효과 및 한계점에 관한 연구', ’한국경영과학회지‘,제21권,제3호(1996),pp.109-125
  16. 이창효,‘부산지역 전략산업 선정에의 계층화 분석과정 적용', ’경영과학‘,제16권, 제1호(1999),pp.11-23
  17. 임채연,변대호,서의호,허성익, ‘집단 계층적 분석과정 : 평가척도와 일관성 비율 중심', ’한국경영과학회 ‘94 추계학술대회 발표논문집’,1994, pp.247-255
  18. 전자신문,‘디지털 컨텐츠 코리아(II) : 세계각국의 디지털 컨텐츠 산업',2001. 8. 7
  19. 정병호, 조권익, ‘대형공사의 최적입찰자 선정을 위한 계층분석과정(AHP) 모형의 개발', '경영과학', 제16권,제1호(1999),pp.75-88
  20. 정현식, 'AHP를 이용한 DBMS 평가와 선정방안에 관한 연구', '경영연구',제10집 (1996),pp.185-207
  21. 조근태,'기술대안의 전략적 평가를 위한 AHP적용에 있어서 평가자 신뢰성을 고려한 가중치 통합','경영과학‘,제19권, 제2호(2002),pp.139-153
  22. 조성훈,김태성,이영찬,‘Compatibility를 이용한 다수 전문가의 가중치 종합화에 관한 연구’,‘한국경영과학회지’,제23권,제4호(1998),pp.131-140
  23. 최희성,황규승,'AHP 기법에 의한 금융위험관리 소프트웨어 평가에 관한 연구','경영과학',제16권,제2호(1999),pp.51-59
  24. 포토뱅크 멸티미디어(주),'Multimedia Authoring Tool - PhotoBank Pro. 3.2', 2002
  25. 황재성,이승범,김용겸,‘정보시스템 개발시 과업복잡성 및 사용자참여가 사용자만족에 미치는 영향’,‘고객만족경영연구’,제3권,제l호(2001),pp.17-54
  26. Aczel, J. and T.L. Saaty, 'Procedures for Synthesizing Ratio Judgments,' Journal of Mathematical Psychology, Vol.27, No.1 (1983), pp.93-102 https://doi.org/10.1016/0022-2496(83)90028-7
  27. Blanc, L.A. Le and M.T. Jelassi, 'DSS Software Selection: A Multiple Criteria Decision Methodology,' Information and Management, Vol.17, No.1 (1989), pp.49-65 https://doi.org/10.1016/0378-7206(89)90054-2
  28. Byun, D.H., 'The AHP Approach for Selecting an Automobile Purchase Model,' Information and Management, Vol.38, No.2 (2001), pp.289-297 https://doi.org/10.1016/S0378-7206(00)00071-9
  29. Christodoulakis, S. and T. Velissaropoulos, 'Issues in the Design of a Distributed Testbed for Multimedia Information Systems (MINOS),' Journal of Management Information Systems, Vol.4, No.2(1987), pp.8-33 https://doi.org/10.1080/07399018708962836
  30. Dodd, F.J., H.A. Donegan and T.B. Mcmaster, 'A Staistical Approach to Consistency in AHP,' Mathematical Computing Modeling, Vol.18, No.6(1993), pp.19-22 https://doi.org/10.1016/0895-7177(93)90123-G
  31. Fetterman, R.L. and S.K. Gupta, Mainstream Multimedia : Applying Multimedia in Business, Van Nostrand Reinhold, New York, 1993
  32. Harker, P.T., 'Incomplete Pairwise Comparison in the AHP,' Mathematical Modeling, Vol.9, No.1(1987), pp.837-848 https://doi.org/10.1016/0270-0255(87)90503-3
  33. Harker, P.T., 'The Art and Science of Decision Making : The AHP,' in B.L. Golden, E.A. Wasil, and P.T. Harker(Eds,), The AHP : Applications and Studies, Springer Verlarg, New York, (1989), pp.3-36
  34. Hearn, D. and M.P. Baker, Computer Graphics, Prentice-Hall, Englewood Cliffs, 1986
  35. Hwang, S.K., H. Ichihashi and H. Tanaka, 'A Modification of Siskos' Multicriteria Decision-Making Methodology Using Fuzzy Outranking Relations,' Bulletin of the Univ. of Osaka Prefecture, Vol.37, No.2(1988), pp.141-152
  36. Johnson, C.R, W.B. Beine and T.J. Wang, 'A Note on Right-Left Asymmetry in an Eigenvector Ranking Procedure,' Journal of Mathematical Psychology, Vol.19, No.1 (1979), pp.61-64 https://doi.org/10.1016/0022-2496(79)90005-1
  37. Kim, C.S. and Y. Yoon, 'Selection of a Good Expert System Shell for Instructional Purposes in Business,' Information and Management, Vol.23, No.5(1992), pp.249-262 https://doi.org/10.1016/0378-7206(92)90056-L
  38. Korhonen, P., H. Moskowitz and J. Wallenius, 'Multiple Criteria Decision Support: A Review,' European Journal of Operational Research, Vol.63, No.3(1992), pp.361- 375 https://doi.org/10.1016/0377-2217(92)90155-3
  39. Lai, V.S., R.P. Trueblood and B.K. Wong, 'Software Selection : A Case Study of the Application of the AHP to the Selection a Multimedia Authoring System,' Information and Management, Vol.36, No.4(1999), pp.221-232 https://doi.org/10.1016/S0378-7206(99)00021-X
  40. Liberatore, M.J., 'An Extension of the AHP for Industrial R&D Project Selection and Resource Allocation,' IEEE Transactions on Engineering Management, Vol.34, No.1 (1987), pp.12-18
  41. Miller, G.A., 'The Magical Number Seven Plus or Minus Two : Some Limits on Our Capacity for Processing Information,' The Psychological Review, Vol.63, No.1(1956), pp.81-97 https://doi.org/10.1037/h0043158
  42. O'Brien, J.A., Computer in Business Management: An Introduction, 3rd ed., Richard D. Irwin, Homewood, 1982
  43. Plessis, A.L. du, 'A Method for CASE Tool Evaluation,' Information and Management, Vol.25, No.2(1993), pp.93-102 https://doi.org/10.1016/0378-7206(93)90051-T
  44. Poor, A., 'Multimedia Authoring Software,' PC Magazine, (March 1992), pp.223-249
  45. Riedl, J.. V. Mashayekhi, J. Schnepf, M. Claypool and D. Frankowski, 'SuiteSound : A System for Distributed Collaborative Multimedia,' IEEE Transactions on Knowledge and Data Engineering, Vol. 5, No.4 (1993), pp.600-610 https://doi.org/10.1109/69.234772
  46. Robinson, P., Authoring Software, NewMedia 1994 Multimedia Tool Guide: Special Issue, HyperMedia Communications, San Mateo: CA, 1993
  47. Saaty, T.L., 'A Scaling Method for Priorities in Hierarchical Structures,' Journal of Mathematical Psychology, Vol.15, No.3(1977), pp.234-281 https://doi.org/10.1016/0022-2496(77)90033-5
  48. Saaty, T.L., 'Group Decision Making and the AHP,' in B.L. Golden, E.A. Wasil, and P.T. Harker(Eds.), The AHP: Applications and Studies, Springer-Verlag, New York, 1989, pp.59-67
  49. Saaty, T.L., 'Priority Setting in Complex Problems,' IEEE Transactions on Engineering Management, Vol.30, No.3(1983), pp.140-155
  50. Saaty, T.L., The AHP : Planning, Priority Setting, Resource Allocation, McGrawHill, New York, 1980
  51. Saaty, T.L., The Analytic Network Process, RWS Publications, Pittsburgh, 1996
  52. Saaty, T.L. and K.P. Kearns, Analytical Planning: The Organization of Systems, International Series in Modern Applied Mathematics and Computer Science, Vol.7, Pergamon Press, New York, 1985
  53. Shang, J and T Sueyoshi, 'A Unified Framework for the Selection of a Flexible Manufacturing System,' European Journal of Operational Research, Vol.85, No.2(1995), pp.297-315 https://doi.org/10.1016/0377-2217(94)00041-A
  54. Stylianou, A.C., G.R. Madey and R.D. Smith, 'Selection Criteria for Expert System Shells: A Socio-Technical Framework,' Communications of the ACM, Vol. 35, No.10(1992), pp.30-48
  55. Subramanian, G.H. and M. Gershon, 'The Selection of CASE Tools: A Multi-Criteria Decision Making Approach,' Decision Sciences, Vol.22, No.5(1991), pp.1109-1123 https://doi.org/10.1111/j.1540-5915.1991.tb01909.x
  56. Zahedi, F., 'Database Management System Evaluation and Selection Decision,' Decision Sciences, Vol.16, No.1(1985), pp.91-116 https://doi.org/10.1111/j.1540-5915.1985.tb01477.x
  57. Zahedi, F., 'The AHP : A Survey of the Method and Its Applications,' Interfaces, Vol.16, No.4(1986), pp.96-108 https://doi.org/10.1287/inte.16.4.96