The Journal of Information Systems (한국정보시스템학회지:정보시스템연구)

Korea Association of Information Systems (한국정보시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Assessor's Competence and Efficiency of Software Process Assessment

SPA 심사원 능력과 효율성에 관한 연구

  • Received : 2010.03.29
  • Accepted : 2011.06.09
  • Published : 2011.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we verify the relationship, which is presented by ISO/IEC 15504, between the assessor's competence and the efficiency of assessment. The ISO standard has been developed by many formal trial experiences for the software process assessment. The software process assessment determines the process capability, and makes the software process improvement possible in the development cycle. In the field assessment, third-party and team-based assessments are generally recommended. Therefore assessors' competences are essential to achieve the effectiveness and the efficiency of assessment. Survey data are collected from the third-party process assessment of a real IT industry, and the analysis is done by a causal modelling technique - PLS. Some findings are as follows. Depending on assessors' SE experiences, effects of the assessor's competence are existed, and their standard knowledge and assessment skill are effected each other. And the efficiency of assessment depends on the assessor's competence. In addition, the power analysis is presented and future research is suggested, because of many limitations of this study.

Keywords

References

  1. 문태수, 서기철, "환경, 조직, 정보시스템 특성이 ERP시스템의 성공적 구축에 미치는 영향에관한 실증연구," 정보시스템연구, 제15권, 제1호, 2006, pp.73-96.
  2. 이상근, 강민철, 김보연, "혁신확산이론을 바탕으로 한 정보통신기술의 수용요인에 관한 분석적 실증연구," 정보시스템연구, 제14권, 제2호, 2005, pp.257-276.
  3. 이종무, 박철수, 유영관, "IT도입요소를 고려한 외주 SW프로세스품질과 제품품질," 정보시스템연구, 제18권, 제4호, 2009, pp.131-153. https://doi.org/10.5859/KAIS.2009.18.4.131
  4. 정창신, 송정범, 이종무, "SPICE와 심사사례," 한국정보과학회지, 제17권, 제1호, 1999, pp.13-22.
  5. 정학종, Audit Skill, KSPICE 2차 교육, ISO/IEC JTC1/ SC7/ WG10 한국위원회, 1998.
  6. 정호원, 황선명, "소프트웨어 프로세스 심사의 이해: SPICE를 중심으로," 한국정보과학회지, 제17권, 제1호, 1999, pp.6-12.
  7. 정호원, 김길조, 김도관, ISO/IEC 15504 기반의 중소기업을 위한 소프트웨어 표준프로세스, 기술표준원, 2007.
  8. 한국 SPICE 위원회, A Phase 2 Trial Report: KSPICE, 소프트웨어 프로세스 심사원 워크샵, 1998
  9. 한국 SPICE 위원회, KSPICE 심사원 교육자료, 2006.
  10. Al-Kilidar, H., Cox, K., and Kitchenham, B., "The Use and Usefulness of the ISO/IEC 9126 Quality Standard," Proc. of ISESE 2005, Noosa Heads, Australia, 2005, pp.126-132.
  11. Boehm, B. W., Brown, J. R., and Kaspar, J. R., Characteristics of Software Quality, TRW Series of Software Technology, Amsterdam, North Holland, 1978.
  12. Chin, W., "Issues and Opinion on Structural Eqaution Modeling," MIS Quarterly, Vol.22, No.1, 1998, pp.7-16.
  13. Chin, W., The Partial Least Square Approach to Structural Equation Modeling, Modern Methods for Business Research, ed. by G. Marcoulides, LEA, 1998, pp.295-336
  14. Chin, W., and Newsted, P., Structural Equation Modeling Analysis with Small Samples Using Partial Least Squares, Statistical Strategies for Small Sample Research, Sage Pub. Co., 1999.
  15. Chua, B. and L. Dyson, "Applying the ISO 9126 Model to the Evaluation of an e-Learning System," ASCILITE Conference Proceeding, 2004, pp.184-190.
  16. CMMI for Development, Ver. 1.2, Technical Report CMU/SEI-2006-TR-008, 2006.
  17. Cohen, J., Statistical Power Analysis for the Behavioral Sciences, 2nd ed., Lawrence Erlbaum, Hilsdale, NJ, 1988.
  18. Diamantopoulos, A., and Winklhofer, H. M., "Index Construction with Formative Indicators: An Alternative to Scale Development," Journal of Marketing Research, Vol.38, No.2, 2001, pp.269-277 https://doi.org/10.1509/jmkr.38.2.269.18845
  19. Emam, K., Drouin, J., and Melo, W., SPICE: The Theory and Practice of Software Process Improvement and Capability Determination, IEEE Computer Society Press, 1998.
  20. Emam, K., and Birk, A., "Validating the ISO/IEC 15504 Measure of Software Requirement Analysis Process Capability," IEEE Transaction on Software Engineering, Vol.26, No.6, 2000, pp.541-566. https://doi.org/10.1109/32.852742
  21. Fornell, C. and Larcker, D. F., "Evaluating Structural Equation Models with Unobservable Variables and Measurement Error," Journal of Marketing Research, Vol.18, No.1, 1981, pp.39-50. https://doi.org/10.2307/3151312
  22. Gefen, D., and Straub, D., "The Relative Importance of Perceived Ease of Use in IS Adoption: A Study of e-Commerce Adoption," Journal of Information Systems, Vol.1, No.8, 2000.
  23. Gefen, D., and Straub, D., "A Practical Guide to Factorial Validity Using PLS-GRAPH," Comm. of the Association for Information Systems, Vol.16, 2005, pp.91-109.
  24. Goodhue, D. and Thompson, R., "PLS, Small Sample Size, and Statistical Power in MIS Research," The 39th Hawaii International Conference on System Sciences, 2006.
  25. Haase, V., "Software Process Assessment Concepts," Journal of Systems Architecture, Vol.42, 1996, pp.621-631. https://doi.org/10.1016/S1383-7621(96)00050-1
  26. Hulland, J., "Use of Partial Least Squares in Strategic Management Research: A Review of Four Recent Studies," Strategic Management Journal, Vol.20, 1999, pp.195-204. https://doi.org/10.1002/(SICI)1097-0266(199902)20:2<195::AID-SMJ13>3.0.CO;2-7
  27. ISO/IEC 12207, Information Technology - Software Life Cycle Processes, ISO, 1995.
  28. ISO/IEC IS-15504, Information Technology -Software Process Assessment, (All parts) ISO, Geneva, Switzerland, 2004.
  29. Johnson, R. and Wichern, D., Applied Multivariate Statistical Analysis, 3rd Ed., Prentice Hall, New Jersey, 1992.
  30. Jorgensen, M. and D. Sjoberg, "Generalization and Theory Building in Software Engineering Research," Empirical Assessment in Software Engineering Proceeding, 2004, pp.29-36.
  31. Jung, H., R. Hunter, D. Goldenson, and K. Emam, "Findings from Phase 2 of the SPICE Trials," Software Process Improvement and Practice, Vol.6, No.5, 2001, pp.205-242. https://doi.org/10.1002/spip.146
  32. Jung, H. and R. Hunter, "Evaluating the SPICE Rating Scale with Regard to the Internal Consistency of Capability Measures," Software Process Improvement and Practice, Vol.8, No.3, 2003, pp.169-178. https://doi.org/10.1002/spip.178
  33. Jung, H., S. Kim, and C. Chung, "Measuring Software Product Quality: A Survey of ISO/IEC 9126," IEEE Software, Vol.21, No.5, 2004, pp.88-92.
  34. Jung, H., "Validating the External Quality Subcharacteristics of Software Products according to ISO/IEC 9126," Computer Standards & Interfaces, Vol.29, 2007, pp.653-661. https://doi.org/10.1016/j.csi.2007.03.004
  35. Mackie, C., "Process Excellence and Capability Determination," BT Technology Journal, Vol.15, No.3, 1997, pp.130-139.
  36. Pfleerger, S. and N. Fenton, S. Page, "Evaluating Software Engineering Standards," Computer, Vol.27, No.9, 1994, pp.71-79.
  37. Rout, T., K. Emam, M. Fusani, D. Goldenson, and H, Jung, "SPICE in Retrospect: Developing a Standard for Process Assessment," Journal of Systems and Software, Vol.80, No.9, 2007, pp.1483-1493. https://doi.org/10.1016/j.jss.2007.01.045
  38. SPICE, Phase 2 Trial Interim Report, Version 1.0, ISO/IEC JTC1/SC7/WG10, 1998.
  39. Tenenhaus, M., V. Vinzi, Y. Chatelin, and C. Lauro, "PLS Path Modeling," Computational Statistics and Data Analysis, Vol.48, No.1, 2005, pp.159-205. https://doi.org/10.1016/j.csda.2004.03.005
  40. Valenti, S., A. Cucchiarelli, and M. Panti, "Computer Based Assessment Systems Evaluation via the ISO9126 Quality Model," Journal of Information Technology Education, Vol.1 No.3, 2002.
  41. Wixom, B., and Todd, P., "A Theoretical Integration of User Satisfaction and Technology Acceptance," Information Systems Research, Vol.16, No.1, 2005, pp.85-102. https://doi.org/10.1287/isre.1050.0042