• Title/Summary/Keyword: Robustness Testing

Search Result 85, Processing Time 0.027 seconds

Study of State Machine Diagram Robustness Testing using Casual Relation of Events (이벤트 의존성을 이용한 상태 머신 다이어그램의 강건성 테스팅 연구)

  • Lee, Seon-Yeol;Chae, Heung-Seok
    • Journal of KIISE
    • /
    • v.41 no.10
    • /
    • pp.774-784
    • /
    • 2014
  • Studies of fault-injection into state machine diagram have been studied for generating robustness test cases. Conventional studies have, however, tended to inject too many faults into diagrams because they only have considered structural aspects of diagrams. In this paper, we propose a method that aims to reduce the number of injected fault without a decrease in effectivenss of robustness test. A proposed method is demonstrated using a microwave oven sate machine diagram and evaluated using a hash table state machine diagram. The result of the evaluation shows that the number of injected faults is decreased by 43% and the number of test cases is decreased by 63% without a decrease in effectiveness of hash table robustness test.

A Practical Intent Fuzzing Tool for Robustness of Inter-Component Communication in Android Apps

  • Choi, Kwanghoon;Ko, Myungpil;Chang, Byeong-Mo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.9
    • /
    • pp.4248-4270
    • /
    • 2018
  • This research aims at a new practical Intent fuzzing tool for detecting Intent vulnerabilities of Android apps causing the robustness problem. We proposed two new ideas. First, we designed an Intent specification language to describe the structure of Intent, which makes our Intent fuzz testing tool flexible. Second, we proposed an automatic tally method classifying unique failures. With the two ideas, we implemented an Intent fuzz testing tool called Hwacha, and evaluated it with 50 commercial Android apps. Our tool offers an arbitrary combination of automatic and manual Intent generators with executors such as ADB and JUnit due to the use of the Intent specification language. The automatic tally method excluded almost 80% of duplicate failures in our experiment, reducing efforts of testers very much in review of failures. The tool uncovered more than 400 unique failures including what is unknown so far. We also measured execution time for Intent fuzz testing, which has been rarely reported before. Our tool is practical because the whole procedure of fuzz testing is fully automatic and the tool is applicable to the large number of Android apps with no human intervention.

A study on Communication Robustness Testing for Industrial Control Devices (산업용 제어기기의 통신 견고성 시험 방안 연구)

  • Park, Kyungmi;Shin, Donghoon;Kim, WooNyon;Kim, SinKyu
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.29 no.5
    • /
    • pp.1099-1116
    • /
    • 2019
  • Industrial control systems(ICS) are widely used in various industrial area and critical infrastructure. To mitigate security threats on ICS, the security assurance test for industrial control devices has been introduced and operating. The test includes testing of the security function of the device itself and testing of communication robustness. In this paper, we describe the security requirements of EDSA, Achilles, and Korea's TTA standard(security requirements for ICS). And also, we analyzed the characteristics of communication robustness test(CRT) of each certification. CRT verifies the device's operation of essential function while transmitting fuzzing and stress packets. Existing test methods are mostly focused on the embedded devices and are difficult to apply to various devices. We propose a method to test communication robustness which reflect the characteristics of control H/W, control S/W, field devices and network devices in ICS. In the future, we will apply the proposed communication robustness test to actual products and present solutions for arising issues.

Robustness Testing of Java Virtual Machine using fault injection (폴트 삽입 방식을 통한 자바 가상 기계의 강건성 테스팅(Robustness Testing) 기법)

  • 이성민;김상운;강제성;권용래
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.355-357
    • /
    • 2004
  • Java의 경우 기존의 강건성 테스팅 방법인 ballista로는 객체 타입의 인자 및 파일 시스템의 변화를 시뮬레이션 할 수 없다. 따라서 객체에 대한 특별한 접근을 필요로 한다. 본 논문에서는 객체에 폴트를 삽입하는 방식을 통하여 자바 가상 기계의 강건성(Robustness)을 테스팅하는 방법을 제안한다. 자바 디버깅 툴인 JPDA를 사용하여 자바 가상 머신에 대한 직접적인 접근 및 의도한 상태 및 환경 변경을 가능하게 하고 이를 통해 자바 가상 기계에 폴트가 심어진 객체를 수행시킬 수 있다. 객체를 수행시키고 의도한 예외상황의 발생 유무를 관찰함으로써 자바 가상 기계의 강건성을 테스트 할 수 있다.

  • PDF

Consequence-based robustness assessment of a steel truss bridge

  • Olmati, Pierluigi;Gkoumas, Konstantinos;Brando, Francesca;Cao, Liling
    • Steel and Composite Structures
    • /
    • v.14 no.4
    • /
    • pp.379-395
    • /
    • 2013
  • Aim of this paper is to apply to a steel truss bridge a methodology that takes into account the consequences of extreme loads on structures, focusing on the influence that the loss of primary elements has on the structural load bearing capacity. In this context, the topic of structural robustness, intended as the capacity of a structure to withstand damages without suffering disproportionate response to the triggering causes while maintaining an assigned level of performance, becomes relevant. In the first part of this study, a brief literature review of the topics of structural robustness, collapse resistance and progressive collapse takes place, focusing on steel structures. In the second part, a procedure for the evaluation of the structural response and robustness of skeletal structures under impact loads is presented and tested in simple structures. Following that, an application focuses on a case study bridge, the extensively studied I-35W Minneapolis steel truss bridge. The bridge, which had a structural design particularly sensitive to extreme loads, recently collapsed for a series of other reasons, in part still under investigation. The applied method aims, in addition to the robustness assessment, at increasing the collapse resistance of the structure by testing alternative designs.

A Testing on Robustness of Embedded Software Based on Software-in-the-Loop Simulation (Software-in-the-Loop 시뮬레이션 기반의 임베디드 소프트웨어의 견고성 테스팅)

  • Jeong, Sooyong;Baek, Tae-San;Hwang, Bueng Il;Lee, Woo Jin
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2015.07a
    • /
    • pp.5-8
    • /
    • 2015
  • 소프트웨어의 작동 중에 중대한 고장 없이 유연하게 대처할 수 있는 성질은 견고성이라 불리며 임베디드 소프트웨어에서 중요하게 여겨진다. 본 논문에서는 개발 중인 임베디드 소프트웨어의 견고성을 조기에 검증하기 위하여, 실물 시스템을 이용한 테스트가 갖는 물리적 한계를 극복할 수 있는 Software-in-the-Loop 시뮬레이션을 이용하여 개발 중인 PC에 견고성 테스팅 환경을 갖추는 방법을 제시한다. 제시한 방법은 소프트웨어의 견고성을 표현할 수 있게끔 만드는 테스트 케이스를 생성하고, 가상 시뮬레이션 환경을 구성하여 테스트 케이스를 실행함으로써 소프트웨어의 견고성을 객관적인 수치의 형태로 나타내는 방법을 보인다.

  • PDF

ADAPTIVE FDI FOR AUTOMOTIVE ENGINE AIR PATH AND ROBUSTNESS ASSESSMENT UNDER CLOSED-LOOP CONTROL

  • Sangha, M.S.;Yu, D.L.;Gomm, J.B.
    • International Journal of Automotive Technology
    • /
    • v.8 no.5
    • /
    • pp.637-650
    • /
    • 2007
  • A new on-line fault detection and isolation(FDI) scheme has been proposed for engines using an adaptive neural network classifier; this paper investigates the robustness of this scheme by evaluating in a wide range of operational modes. The neural classifier is made adaptive to cope with the significant parameter uncertainty, disturbances, and environmental changes. The developed scheme is capable of diagnosing faults in the on-line mode and can be directly implemented in an on-board diagnosis system(hardware). The robustness of the FDI for the closed-loop system with crankshaft speed feedback is investigated by testing it for a wide range of operational modes, including robustness against fixed and sinusoidal throttle angle inputs, change in load, change in an engine parameter, and all changes occurring simultaneously. The evaluations are performed using a mean value engine model(MVEM), which is a widely used benchmark model for engine control system and FDI system design. The simulation results confirm the robustness of the proposed method for various uncertainties and disturbances.

A Robustness Test Method and Test Framework for the Services Composition in the Service Oriented Architecture (SOA에서 서비스 조합의 강건성 테스트 방법 및 테스트 프레임워크)

  • Kuk, Seung-Hak;Kim, Hyeon-Soo
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.10
    • /
    • pp.800-815
    • /
    • 2009
  • Recently, Web services based service-oriented architecture is widely used to integrate effectively various applications distributed on the networks. In the service-oriented architecture BPEL as a standard modeling language for the business processes provides the way to integrate various services provided by applications. Over the past few years, some types of studies have been made on testing compatibility of services and on discriminating and tracing of the business processes in the services composition. Now a lot of studies about the services composition with BPEL are going on. However there were few efforts to solve the problems caused by the services composition. Especially, there is no effort to evaluate whether a composite service is reliable and whether it is robust against to exceptional situations. In this paper, we suggest a test framework and a testing method for robustness of the composite service written in WS-BPEL. For this, firstly we extract some information from the BPEL process and the participant services. Next, with the extracted information we construct the virtual testing environment that generates various faults and exceptional cases which may be raised within the real services. Finally the testing work for robustness of a composite service is performed on the test framework.

The Nonparametric Test for Detecting Main Effects for Three-Way ANOVA Models

  • Park, Young-Hun
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.3
    • /
    • pp.419-432
    • /
    • 1996
  • When interactions are not present in a three-way layout, the lim-iting null distribution of the F statistic for testing main effects when applied to the rank-score transformed data is the same as the limiting null distribution of the usual F statistic when applied to the normal data. The simulation results exhibit that the rank transform test is robust with respect to significance level and powerful for testing main effects in a three-way factorial experiment.

  • PDF

The Relationship between the Preceding Factors of Supply Chain Resilience, Supply Chain Resilience, and Business Performance (공급사슬 회복탄력성 선행요인과 공급사슬 회복 탄력성, 기업 경영성과 간의 관계)

  • Park, Chan-Kwon;Seo, Yeong-Bok
    • Korean small business review
    • /
    • v.43 no.2
    • /
    • pp.1-30
    • /
    • 2021
  • This study is to analyze the relationship between supply chain resilience antecedent factors, supply chain resilience and business performance. Supply chain integration, risk management activity, and visibility were selected as the preceding factors of supply chain resilience, and the effect of these factors on agility and robustness as supply chain resilience, and the effects of agility and robustness factors on corporate management performance are studied. To this end, a survey was conducted on Korean manufacturing companies, and a total of 124 questionnaires were used for the study. As a result of the testing of the research hypothesis, supply chain integration, risk management activity, and visibility have a positive (+) significant effect on agility and robustness. In addition, agility had a positive (+) effect on corporate management performance. But robustness had a positive (+) effect on corporate management performance, but not significant. In order for manufacturing companies to secure supply chain resilience through such research hypothesis testing, it is necessary to secure supply chain integration, risk management activity, and visibility capabilities. It was confirmed that agility and visibility capability can be linked to corporate management performance. In addition, the overall relationship structure between the preceding factors of supply chain resilience, supply chain resilience, and business performance was presented.