• Title/Summary/Keyword: Software Evaluation

Search Result 2,549, Processing Time 0.031 seconds

A Study on Proficiency Comparison Testing Between Testers Using ISO/IEC 25023 Software Quality Characteristics Evaluation (ISO/IEC 25023 소프트웨어 품질 특성 평가를 이용한 시험자간 비교시험에 관한 연구)

  • Lee, Chang-Hee;Kim, Myung-Sup;Kim, Yoon-Sook;Noh, A-Reum;Yang, Jung-Sim;Song, Sung-Hyun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.6
    • /
    • pp.18-27
    • /
    • 2020
  • This study compared and analyzed the results of proficiency testing between testers based on the international standard ISO/IEC 17043 proficiency testing requirements using ISO/IEC 25023 software quality characteristics evaluation. Application of the test was submitted to the KASTO as a software test in the electric test field defined by KOLAS. Among ISO/IEC 25023, the evaluation items for proficiency testing between testers were selected as functional completeness and time behavior. The comparison test between testers was carried out on May 28, 2019 at the accredited LG Electronics SW Laboratory in Seoul and attended by KOLAS assessors. The test evaluation method was measured once per tester with functional completeness, and measurement was repeated 10 times per tester according to time behavior. As a result, in the case of functional completeness, all 12 test steps were passed, and the satisfaction was evaluated. Time behavior was repeated 10 times, and the mean was 9.45 ± 0.01 seconds for testers 1 and 3 and 9.52 ± 0.0 seconds for tester 2, but there was no statistically significant difference. In conclusion, the proficiency of the testers was equal, and the reliability of the test results of the test institute was confirmed.

The Software Reliability Evaluation of a Nuclear Controller Software Using a Fault Detection Coverage Based on the Fault Weight (가중치 기반 고장감지 커버리지 방법을 이용한 원전 제어기기 소프트웨어 신뢰도 평가)

  • Lee, Young-Jun;Lee, Jang-Soo;Kim, Young-Kuk
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.5 no.9
    • /
    • pp.275-284
    • /
    • 2016
  • The software used in the nuclear safety field has been ensured through the development, validation, safety analysis, and quality assurance activities throughout the entire process life cycle from the planning phase to the installation phase. However, this evaluation through the development and validation process needs a lot of time and money, and there are limitations to ensure that the quality is improved enough. Therefore, the effort to calculate the reliability of the software continues for a quantitative evaluation instead of a qualitative evaluation. In this paper, we propose a reliability evaluation method for the software to be used for a specific operation of the digital controller in a nuclear power plant. After injecting weighted faults in the internal space of a developed controller and calculating the ability to detect the injected faults using diagnostic software, we can evaluate the software reliability of a digital controller in a nuclear power plant.

A Software Design Methodology Integrating Evaluation Method of Architectural Design Approaches (아키텍처기반 설계 방식에 대한 평가기능이 통합된 소프트웨어 설계 방법론)

  • Koh, Hyon-Hee;Kung, Sang-Hwan;Park, Jae-Nyon
    • Journal of KIISE:Software and Applications
    • /
    • v.34 no.7
    • /
    • pp.625-634
    • /
    • 2007
  • Due to the software is getting complex and large, software architecture design is issued for success of project. In the design phase, selection of the suitable architectural approach is very important. In this thesis, we identify the architectural approach alternatives in the design phase. And the evaluation method to choose architectural approaches and the architecture design methodology integrated with that evaluation method are proposed In the proposed architecture evaluation method and the architecture design methodolody, we intend to raise reliability, completeness of design and reduce development costs.

An Estimation Process of Effort and Cost in Security Evaluation of Information Technology Security Systems by utilizing Evaluation Work Break-down Structure (EWBS를 통한 정보보호 시스템의 보안성 평가 업무량 및 비용 산정 프로세스)

  • You, Hyung-Joon;Ko, Jeong-Ho;Chang, Soo-Jin;Ahn, Sun-Suk;Lee, Gang-Soo;Jung, Hong-Jin
    • Journal of KIISE:Software and Applications
    • /
    • v.27 no.2
    • /
    • pp.134-147
    • /
    • 2000
  • Even though software industry has been activated, there lack in results of studies on evaluation effort and cost of software systems including Information Technology Security System (ITSS). In this paper, we present a process and a tool for evaluation effort and cost of ITSS, which are conformed to a ITSS evaluation criteria(i. e., Common Criteria or ISO/IEC 15408), by utilizing Evaluation Work Break-down Structure (EWBS) and conventional software development cost estimation methods. Even though we concentrate on ITSS, results of this paper can be applied to estimation of effort and cost of evaluation of software development process and software products.

  • PDF

Development of Functionality Evaluation Model for SOA based Software (SOA 기반 소프트웨어의 기능성 평가 모델 개발)

  • Ham, Yun-Sang;Yang, Hae-Sool
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.9 no.4
    • /
    • pp.970-979
    • /
    • 2008
  • Nowadays, as the importance of SOA-based software is recognized, the market of SOA-based software is getting bigger. In response to this, the requirements about high reliability and quality SOA-based software is getting increased. In this paper, we clearly suggested the evaluation method by giving a specific evaluation example to evaluate the functionality quality of SOA-based software. We expect that this study can raise the objectivity and the utilization by inducing the functionality quality improvement of SOA-based software and developing the strategic technology accepting the international standard.

A methodology for selecting workflow software products: AHP approach (워크플로우 소프트웨어 제품 선정 방법 : AHP 접근)

  • 변대호
    • The Journal of Information Systems
    • /
    • v.12 no.1
    • /
    • pp.145-158
    • /
    • 2003
  • Workflow is the automation of a business process, in whole or part, during which documents, information or tasks are passed from one participant to another for action, according to a set of procedural rules. The software selection problem is made difficult by the multiplicity of competing products and the lack of expertise and experience of users in the methods of software evaluation. Although the selection process for workflow is similar to that proposed for the acquisition of any software packages, differences arise in their evaluation criteria and choice methods. In this paper, we suggest the Analytic Hierarchy Process(AHP) method for selecting workflow software. The AHP is an intuitively easy method for formulating and analyzing decisions. It was developed to solve a specific class of problems that involves prioritization of potential alternate solutions. We showed how to evaluate 9 commercial workflow products by deciding the relative importance of the main criteria in the AHP model. We utilized the evaluation data for criteria ready suggested by specialist groups. Our methodology will be helpful to those who are going to adopt a best workflow product in their organizations. Although the criteria and their evaluation scores regarding workflow products are suggested, it is not easy to apply them to a real case and get solutions without a model.

  • PDF

A Quality Evaluation and Analysis of the On-Line Edutainment Software (온라인 에듀테인먼트 품질 평가 및 분석)

  • Lho, Young-Uhg;Park, Sang-Won;Jung, Deok-Gil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.11
    • /
    • pp.2192-2198
    • /
    • 2007
  • An edutainment is a composite which are joining with the serveral matter and the multiplicity of techqniues An Eduainment software use serveral audio and video media. The human have different preference to audio and video media. It is difficult to evaluate quality of an edutainment software than a general software. So, we need an evaluation factors to compare quality of edutainment software. We developed the evaluation factors for edutainment software. And the middle school students used the evaluation factors to evaluate the favorite edutainment softwares among them. We evaluate and analyze the results.

Development of Package Software Test Process and Evaluation Module (패키지 소프트웨어 시험 프로세스와 평가모듈의 개발)

  • Lee, Ha-Yong;Hwang, Suk-Hyung;Yang, Hae-Sool
    • The KIPS Transactions:PartD
    • /
    • v.10D no.5
    • /
    • pp.821-828
    • /
    • 2003
  • Package software should have the feature that enables purchasers to discriminate a product suitable for them among a number of software belonging to the similar kind of product. Purchaser's ability to choose a package software depends on whether they can judge that a package software conforms to the relevant standard through an objective quality test process and method or not. There are the standards that can be applicable to the quality evaluation of package software, such as and . This study developed a system with which purchasers can effectively select a package software suitable for their needs, building quality test process for package software and developing test metric and application method.