The Journal of Society for e-Business Studies (한국전자거래학회지)

Society for e-Business Studies (한국전자거래학회)
권호 표지
DOI QR코드

DOI QR Code

The Significance Test on the AHP-based Alternative Evaluation: An Application of Non-Parametric Statistical Method

AHP를 이용한 대안 평가의 유의성 분석: 비모수적 통계 검정 적용

  • Park, Joonsoo (Department of Statistics & Actuarial Science, Soongsil University, Center for Defense Acquisition, Korea Institute for Defense Analyses) ;
  • Kim, Sung-Chul (Department of Statistics & Actuarial Science, Soongsil University)
  • Received : 2016.12.29
  • Accepted : 2017.02.03
  • Published : 2017.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

The method of weighted sum of evaluation using AHP is widely used in feasibility analysis and alternative selection. Final scores are given in forms of weighted sums and the alternative with largest score is selected. With two alternatives, as in feasibility analysis, the final score greater than 0.5 gives the selection but there remains a question that how large is large enough. KDI suggested a concept of 'grey area' where scores are between 0.45 and 0.55 in which decisions are to be made with caution, but it lacks theoretical background. Statistical testing was introduced to answer the question in some studies. It was assumed some kinds of probability distribution, but did not give the validity on them. We examine the various cases of weighted sum of evaluation score and show why the statistical testing has to be introduced. We suggest a non-parametric testing procedure which does not assume a specific distribution. A case study is conducted to analyze the validity of our suggested testing procedure. We conclude our study with remarks on the implication of analysis and the future way of research development.

공공사업 타당성 평가나 대안 선정에서는 대부분 AHP 기법을 활용하여 대안별 가중합 방식으로 최종 점수를 산정하고 그 값이 가장 큰 대안을 선택하고 있다. 특히 타당성 분석과 같은 경우에는 최종 점수가 0.5보다 큰 대안을 선택하게 되는데, 그 값이 0.5보다 얼마나 커야 의사결정이 의미있고 설득력있는 판단이라고 할 수 있는지에 대한 합리적인 기준 없이 적용되고 있다. 한국개발연구원(KDI)에서 제시한 방법론에는 사업진행 대안의 종합 점수가 0.5 근처에 있는 경우를 회색 영역으로 구분하여 신중한 결정을 하도록 제시하고 있는데, 세부기준에 관한 이론적 검토는 빈약하다. 반면, 통계적 검정의 개념을 도입하여 시도된 분석사례에서는 가중합 평가 점수의 확률분포로서 정규분포 또는 베타분포를 가정하였으나, 이에 대한 분포적 타당성은 제시되지 않았다. 본 논문에서는 현재 다양한 분야에서 적용되고 있는 가중합 평가 방식의 사례를 검토하여 그 결과의 통계적 검정의 필요성을 제기하고, 통계적 검정을 위하여 특정 분포를 가정하지 않는 비모수적 검정 방법을 제시한다. 그리고 본 연구에서 제시한 방법을 국방 분야의 사례에 적용하고 그 함의와 함께 향후 연구의 발전방향을 제안한다.

Keywords

References

  1. Ahn, S. H. et al., "A Study on General Guidelines for Pre-feasibility Study: The 5th revision," Korea Development Institute, 2008.
  2. Byun, D.-H., "Selecting a Mobile Device Using the Analytic Hierarchy Process," Journal of Digital Convergence, Vol. 9, No. 4, pp. 1-8, 2011.
  3. Chang, T., Jeong, H., Seo, Y., and Lee, S., "A Feasibility Study on Construction of Integrated Mail Processing System," Entrue Journal of Information Technology, Vol. 7, No. 2, pp. 151-163, 2008.
  4. Choi, H., Lee, C., Shon, J., Lee, H., Lee, H., and Shin, J., "Selection of Optimum Alternative for Deploying Automated Gate System in Container Terminal," Entrue Journal of Information Technology, Vol. 8, No. 2, pp. 171-181, 2009.
  5. Eo, H. and Kim, S.-C., "Contract Awarding Process and its Reasonable Improvement for Defense Acquisition," Journal of the Korea society of IT services, Vol. 14, No. 2, pp. 69-86, 2015. https://doi.org/10.9716/KITS.2015.14.2.069
  6. Jeong, D. H., Kim, H. Y., Gi, B. J., Park, K. H., and Jin, Y. S., "Application of analytic hierarchy process on the feasibility of watershed management program by construction and operation of an integrated sewerage system in the upper watershed of Dam Chung-Ju," Proceedings of the KSEE Fall Conference, Korean Society of Environmental Engineers, pp. 98-103, 2004.
  7. Jeong, H. C., Lee, J. C., and Jhun, M., "A Study for Obtaining Weights in Pairwise Comparison Matrix in AHP," The Korean Journal of Applied Statistics, Vol. 25, No. 3, pp. 531-541, 2012. https://doi.org/10.5351/KJAS.2012.25.3.531
  8. Jun, H., Cho, S., Kim, S., and Kim, D.-G., "A Study on Engineering Project Selection," Entrue Journal of Information Technology, Vol. 12, No. 2, pp. 91-105, 2013.
  9. Kim, B., Park, J.-R., and Kim, H., "Development and Application of the Evaluation Model of Internet Portal Sites as an Advertising Medium: Employing Analytic Hierarchy Process(AHP)," The Korean Journal of Advertising, Vol. 23, No. 6, pp. 29-51, 2012.
  10. Kim, J. H. et al., A Study on General Guidelines for Pre-feasibility Study: the 1st version, Korea Development Institute, 1999.
  11. Kim, K.-H., Park, G.-W., and Hwang, S.-J., "An Evaluation Model of IT PMO Performance Using Pentagon Model," The Journal of Society for e-Business Studies, Vol. 21, No. 4, pp. 119-136, 2016. https://doi.org/10.7838/JSEBS.2016.21.4.119
  12. Kim, K. O. and Yoo, H. Y., "An Evaluation of Software Development Methodology Applicability at Medium and Small Business through AHP," KIPS Transactions on Software and Data Engineering, Vol. 2, No. 10, pp. 691-696, 2013. https://doi.org/10.3745/KTSDE.2013.2.10.691
  13. Kim, W. Y., "A Study on Validity Analysis about the Regional Airport Development," Journal of the Korean Society for Aeronautical and Flight Operation, Vol. 16, No. 3, pp. 21-30, 2008.
  14. Kwon, K.-M., Seo, S.-D., and Jung, B.-H., "Evaluation of Green Car Technologies for Military Transport Use with AHP Analysis," Journal of Transport Research, Vol. 17, No. 2, pp. 97-111, 2010.
  15. Lee, D. K., Park, S. U., Yang, J. T., and Gim, B. J., "An Assessment of the Alternative Selection of Energy System using AHP," Environmental and Resource Economics Review, Vol. 12, No. 4, pp. 611-635, 2003.
  16. Lee, J. C., Jhun, M., and Jeong, H. C., "A Statistical Testing of the Consistency Index in Analytic Hierarchy Process," The Korean Journal of Applied Statistics, Vol. 27, No. 1, pp. 103-114, 2014. https://doi.org/10.5351/KJAS.2014.27.1.103
  17. Park, J., Cho, N.-W., and Kim, W., "A Study on the IT Project Selection Considering Budget Constraints," The Journal of Society for e-Business Studies, Vol. 18, No. 4, pp. 327-338, 2013. https://doi.org/10.7838/jsebs.2013.18.4.327
  18. Park, S. and Kim, D., "Nonparametric Method for a Non-inferiority Test using Confidence Interval," The Korean Journal of Applied Statistics, Vol. 27, No. 5, pp. 833-842, 2014. https://doi.org/10.5351/KJAS.2014.27.5.833
  19. Saaty, T., The Analytic Hierarchy Process, McGraw-Hill, New York, 1980.
  20. Saaty, T., Multicriteria Decision Making: The Analytic Hierarchy Process, McGraw- Hill, New York, 2003.
  21. Song, M. S. and Park, C. S., Introduction to Non-parametric Statistics, Free Academy Publishing Co., 1989.
  22. Yang, C. H., Yeo, G. T., Jang, H. J., Kim, H. K., and Son, Y. L., "Analysis on Non-Market Benefit of Port Re-Modeling Factor Using AHP," Journal of Korean Society of Coastal and Ocean Engineers, Vol. 23, No. 1, pp. 57-62, 2011. https://doi.org/10.9765/KSCOE.2011.23.1.057