• Advanced Industrial SCIence
• /
• v.1 no.1
• /
• pp.28-34
• /
• 2022

Many studies have been conducted on software quality evaluation. Recently, as artificial intelligence-related software has been developed a lot, research on methods for evaluating artificial intelligence functions in existing software is being conducted. Software evaluation has been based on eight quality characteristics: functional suitability, reliability, usability, maintainability, performance efficiency, portability, compatibility, and security. Research on the part that needs to be confirmed through evaluation of the function of the intelligence part is in progress. This study intends to introduce the contents of the evaluation method in this part. We are going to propose a quality evaluation method for artificial intelligence software by presenting the existing software quality evaluation method and the part to be considered in the AI part.

• Journal of KIISE:Software and Applications
• /
• v.29 no.12
• /
• pp.907-925
• /
• 2002

Due to the emersion of J2EE(Java 2, Enterprise Edition), many enterprises inside and outside of the country have been developing the enterprise applications appropriate to the J2EE model. With the help of the component model of Enterprise Java Beans(EJH) which is the J2EE core technology, we can develop the distributed object applications quite simple. EJB application can be implemented by using the component-oriented object transaction middleware and the most applications utilize the distributed transaction. EJB developers can concentrate on the business logic because the EJB server covers the middleware service. Due to these characteristics, EJB technology became popular and then the study for EJB based application has been done quite actively However, the research of metrics for measuring the performance during run-time of the EJB applications has not been done enough. Tn this paper, we explore the workflow for the EJB application service on the run-time and classify the internal operation into several elements. We propose the metrics for evaluating the performance up to the bean level by using the classified elements. First, we analyze the lifecycle according to the bean types which comes from the EJB application on the run-time as to extract each factor used in performance measurement. We also find factors related to a performance and allocate the Performance factors to the metrics as the bean types. We also consider the characteristics like the bean's activation and message passing which happens during bean message call and then analyze the relations of the beans participating in the workflow of the application to make the workflow performance measurement possible. And we devise means to bring performance enhancement of the EJB application using the propose.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.26 no.1
• /
• pp.37-43
• /
• 2018

There has been the migration to a performance-based approach in many areas which include transition planning at global, regional and local levels, performance-based navigation and safety management. Achieving continuous success of Air Traffic Management (ATM) systems would require a performance-based approach to raise productivity and efficiency of it through performance measurements and reviews. This paper considers establishment planning of performance measurement and evaluation system for ATM. Related to key performance areas proposed by International Civil Aviation Organization, performance indicators and metrics which could be used to measure and evaluate ATM performance are presented. Also, organizational system and operational planning for efficient operation of ATM are presented.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.292-297
• /
• 2008

유비쿼터스 컴퓨팅 서비스 환경은 사용자와 시스템간의 상호작용성이 매우 중요하며, 이러한 상호작용성을 사용자 중심의 시각에서 평가하기 위한 새로운 평가 기법의 개발이 필요하다. 본 연구는 유비쿼터스 서비스의 특성이 반영된 사용자 중심의 상호작용성 평가 metric 개발을 목표로 한다. 이를 위하여 첫째, 기존의 유비쿼터스 서비스 평가방법론을 검토하여, 유비쿼터스 서비스 평가를 위한 평가 속성을 정의하였으며, 둘째, 대인 서비스 평가기법, 사용성 평가기법, 정신측정학 기반의 평가기법 등의 기존의 서비스 평가방법론의 한계를 극복할 수 있는 사용자중심의 상호작용성 평가 metric 을 개발하였다. 그리고 본 연구에서 제안된 평가 metric 을 u-home 서비스의 평가에 실제로 적용하여 그 유효성을 검증하고 각 지표별 중요도를 구해보았다. 본 연구에서 제안한 상호작용성 평가 metric 은 유비쿼터스 서비스 상호작용성 수준을 평가함으로써 잠재 서비스 사용자들을 분석하고, 제안된 프레임워크의 서비스 개발단계에서의 잠재 서비스 사용자에 대한 요구사항 수렴 및 수준 파악에 유용하게 활용될 수 있다.

• Asia pacific journal of information systems
• /
• v.13 no.4
• /
• pp.1-27
• /
• 2003

With a swift development of information technology, web sites get more important roles as user's living places. This quantitative and qualitative expansion of web sites requires the need for an evaluation framework of web sites from comprehensive perspectives. This study proposes two dimensions for web site categorization and three dimensions for web site evaluation. These dimensions were developed based on the architectural perspectives that have been used to evaluate buildings in the real world for more than a thousand years. First, in order to categorize various web sites, we extracted two dimensions, user's goals and user's behaviors from behavioral architect which approaches user's behaviors in designing buildings. Second, in order to evaluate four web sites groups, we suggested three dimensions, which are firmness, commodity, delight used in evaluating buildings in the real world. Then for each of the four different web sites groups an empirical survey was conducted to verify these three dimensions of architectural metrics. This ends with study implications and limitations.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2008.11a
• /
• pp.385-386
• /
• 2008

Dynamic stability of the vehicle rearview mirror is an important factor for the driver's visual perception (image blur) when driving down the road and regarded as one of the vehicle level N&V performance of visible component vibration. Several projects within GM identified a set of objective metrics and validation methods that can replace current existing subjective evaluation of mirror stability. This paper presents objective evaluation results for assessing dynamic stability (angle of rotation) of the vehicle rearview mirrors using both in-lab FRF measurements and on-road testing.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2009.10a
• /
• pp.137-142
• /
• 2009

Impact noise is induced in a car when it is driven on a harsh road or over some bumps. This noise occurs with the very high level of sound, which affects passengers in some way or other. Although it is impossible to clearly remove such noise. It is necessary to research an improvement in sound quality for impact noise. A new sound metric for impact sound is presented in the previous work. This metric is verified by comparison between mean subjective ratings and several sound metrics. In this paper, more objective attributes are considered, which are the attributes expressing the level and modulation of sound. Three sound metrics are employed to get impact sound indexes for each course by the method of multiple linear regressions. The indexes are verified by considering the correlation between the estimated values from the multiple linear regressions and the mean subjective ratings by evaluators. Also, the subjective ratings on the indexes are estimated for the case in which some parts of suspension system are changed. The estimated ratings represent more reasonable or acceptable ratings. Thus, such indexes can be used for modification of the parts of suspension system under considering a good sound quality.

• The Transactions of the Korea Information Processing Society
• /
• v.4 no.6
• /
• pp.1508-1518
• /
• 1997

For the effective development of high qualitative software, it is important to measure the "design quality" through the "process of design" which is the upper phase of software development. And based on it, to improve the "design quality" is also important. But, up to now, most of the researches have been in connection with the quality characteristics, and quality sub-characteristics that can be measured and evaluated by users, but the researches about the internal characteristics and metrics that can be measured and evaluated by developer in the process of the development have not been through going enough. Accordingly, the purpose of this research is to point out the problems included in the internal characteristics of the solution of these problems. Omissions and duplications of the internal characteristics can be prevented by arranging than newly according to the model suggestion. Furthermore, it is confirmed that developers can get the efficiency of measurement by metrics, and also can get good improvement effect of metrics measurement accuracy through the concrete application test.

• The Journal of Korean Institute of Electromagnetic Engineering and Science
• /
• v.17 no.3 s.106
• /
• pp.272-279
• /
• 2006

In this paper, we evaluate the performance of frame synchronization words of pilot bit patterns which are used for the channel estimation and frame synchronization confirmation in W-CDMA(Wide band Code Division Multiple Access) system. W-CDMA system also uses compressed mode to make measurements from another frequency without a full dual receiver terminal. It is confirmed by using computer simulation that the proposed frame synchronization words also maintain the frame synchronization property in the compressed mode by using the complementary mapping relationship of preferred pair ROC(Receiver Operating Characteristic) curves with probability of detection and false alarm are used to analized the performance of the proposed frame synchronization words by using the various detection metrics such as LLRT(Log Likelyhood Ratio Test), GLRT(Generalied Likelyhood Ratio Test), soft and hard correlation tests in AWGN and Rayleigh fading channels. It is expected that the research results fer the performance of pilot bit patterns of this paper can be useful reference for the design and implementation of frame synchronization in 3rd generation W-CDMA system.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2008.11a
• /
• pp.393-393
• /
• 2008