• Journal of Korea Multimedia Society
• /
• v.11 no.6
• /
• pp.891-902
• /
• 2008

The software once developed enters in to the $2^{nd}$ phase of its useful operational life, where it performs its functions for which it has been developed. This is an important phase of software life, wherein the developers and users have to assess the performance of the software to prolong its operational life with efficiency, effectiveness and economy. Performance of the software is based on the measurement of the quality characteristics to ascertain that it is meeting or exceeding the needs of customers in terms of its functionality, usability, efficiency, reliability, availability, maintainability, portability etc. These software quality attributes defined under ISO 9126 provide an overall good framework for assessing the performance of the software. This paper describes a Software Performance Assessment (SPA) model using the Goal-Question-Metric (GQM) paradigm which has been applied to the operational software in real context with successful results.

• Asia pacific journal of information systems
• /
• v.16 no.3
• /
• pp.193-203
• /
• 2006

Software reliability prediction is a statistical method to put in place a timely software development practice useful for objective assessment of bidders. The current study suggests one research method that enables reliability assessment of such previous projects by studying user satisfaction and project management history. If incorporated into the existing acquisition process, the reliability assessment method will further enhance objectivity and accuracy in bidder selection process. The GQM(Goal Question Metric) paradigm was used to identify assessment metrics for bidder evaluation and questionnaires were collected from users to create user satisfaction indexes. In addition, 'weight of evidence', the most appropriate categorical method, was used to isolate attributes of each variable that may contribute to reliability assessment.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.6
• /
• pp.2354-2376
• /
• 2020

SmartThings is one of the most popular open platforms for home automation IoT solutions that allows users to create their own applications called SmartApps for personal use or for public distribution. The nature of openness demands high standards on the quality of SmartApps, but there have been few studies that have evaluated this thoroughly yet. As part of software quality practice, code reviews are responsible for detecting violations of coding standards and ensuring that best practices are followed. The purpose of this research is to propose systematically designed quality metrics under the well-known Goal/Question/Metric methodology and to evaluate the quality of SmartApps through automatic code reviews using a static analysis. We first organize our static analysis rules by following the GQM methodology, and then we apply the rules to real-world SmartApps to analyze and evaluate them. A study of 105 officially published and 74 community-created real-world SmartApps found a high ratio of violations in both types of SmartApps, and of all violations, security violations were most common. Our static analysis tool can effectively inspect reliability, maintainability, and security violations. The results of the automatic code review indicate the common violations among SmartApps.

• Proceedings of the Korean Information Science Society Conference
• /
• 2008.06b
• /
• pp.55-59
• /
• 2008

소프트웨어 제품의 품질 확보 및 비용 감소를 위해서 테스트 활동이 중요시되고 있으며 품질을 중시하는 조직에서는 개발 프로세스 내의 독립된 조직에 의해 생산물에 대한 검토 활동이 수행되고 있다. 테스트 조직이 효과적 효율적으로 테스트 활동을 수행하기 위해서는 테스트 활동에 대한 측정 및 평가를 위한 메트릭을 필요로 한다. 하지만 현재 사용하고 있는 메트릭만으로는 테스트 조직의 활동을 평가하고 향상시키기에는 부족하다. 따라서 테스트 조직에 필요한 메트릭 연구가 필요하며 이 메트릭을 통해 테스트 활동에 필요한 지표를 도출할 수 있다. 본 연구에서는 목표-질문-메트릭(GQM: Goal Question Metric)방법을 이용하여 온라인 인터넷 서비스 환경의 테스트 조직에서 사용하고 있는 메트릭을 검토하고 테스트 조직 향상에 필요한 메트릭을 도출한 사례를 제시한다.

• The KIPS Transactions:PartD
• /
• v.12D no.3 s.99
• /
• pp.417-428
• /
• 2005

Today, IT organizations perform projects with vision related to marketing and financial profit. The objective of realizing the vision is to improve the project performing ability in terms of QCD. Organizations have made a lot of efforts to achieve this objective through process improvement. Large companies such as IBM, Ford, and GE have made over $80\%$ of success through business process re-engineering using information technology instead of business improvement effect by computers. It is important to collect, analyze and manage the data on performed projects to achieve the objective, but quantitative measurement is difficult as software is invisible and the effect and efficiency caused by process change are not visibly identified. Therefore, it is not easy to extract the strategy of improvement. This paper measures and analyzes the project performance, focusing on organizations' external effectiveness and internal efficiency (Qualify, Delivery, Cycle time, and Waste). Based on the measured project performance scores, an OT (Opportunity Tree) model was designed for optimizing the project performance. The process of design is as follows. First, meta data are derived from projects and analyzed by quantitative GQM(Goal-Question-Metric) questionnaire. Then, the project performance model is designed with the data obtained from the quantitative GQM questionnaire and organization's performance score for each area is calculated. The value is revised by integrating the measured scores by area vision weights from all stakeholders (CEO, middle-class managers, developer, investor, and custom). Through this, routes for improvement are presented and an optimized improvement method is suggested. Existing methods to improve software process have been highly effective in division of processes' but somewhat unsatisfactory in structural function to develop and systemically manage strategies by applying the processes to Projects. The proposed OT model provides a solution to this problem. The OT model is useful to provide an optimal improvement method in line with organization's goals and can reduce risks which may occur in the course of improving process if it is applied with proposed methods. In addition, satisfaction about the improvement strategy can be improved by obtaining input about vision weight from all stakeholders through the qualitative questionnaire and by reflecting it to the calculation. The OT is also useful to optimize the expansion of market and financial performance by controlling the ability of Quality, Delivery, Cycle time, and Waste.

• The KIPS Transactions:PartD
• /
• v.12D no.1 s.97
• /
• pp.91-102
• /
• 2005

In the past it was generally felt that software quality was the same as product quality. But as the software industry is getting bigger and more complex, it has become hard to develop quality software that meets customers' needs just depending on product quality. Therefore, lately many domestic and foreign companies are making efforts to upgrade product quality by implementing Process Improvement. Measurement in Process Improvement activities enhances the effect of Process Improvement, and also identifies and helps the activities. In support of this paper, research on the measurement program was conducted based on the CMMI adopted by many domestic and foreign companies for their process improvement model. MA process area that deals with measurement process setup is one of the CMMI process areas and was the basis of the structure of the measurement program. This study presents differences of the measurement program for each level of CMMI and how to apply it. The results of this study can help a business to apply CMMI-based Process Improvement by backing up the structure of the measurement program. Furthermore, it can offer a roadmap for progress of the measurement program for each level.