• Journal of Multimedia Information System
• /
• v.5 no.4
• /
• pp.291-297
• /
• 2018

Performance measurement is not an easy task. However, it is necessary to measure the expected value of the informatization project to be invested, to help the successful progress of the informatization project, and to confirm the result of the informatization project. This study describes the evaluation systems of the defense informatization project in Korea used after the end of the informatization project (post-implementation evaluation stage). In the post-implementation evaluation stage of proposed system, the informatization project is evaluated in terms of performance achievement, project plan compliance, project management, and economic validity. For each element, this study suggests metrics and practical measurement method. With metrics and their method, it can be evaluated which project is better than others. Moreover, the lessons learned can be developed. Under scarce budget condition, defense organizations can make better performance from IT project with the evaluation system suggested in this study.

• International Journal of Highway Engineering
• /
• v.14 no.2
• /
• pp.165-174
• /
• 2012

In this study, a method for evaluating the performance of speed measurements was developed to assess the qualities of a vehicle detector. The evaluation method considers measurement errors that are reflected in a reference speed. For this, the concept of uncertainty in measurement was applied to the development method. Other factors such as precedent study, statistical processing techniques, and speed measurement performance method of traffic enforcement equipment and vehicle detection systems were also reviewed. Through this process, the problems of the existing evaluation methods were derived and developed for the new performance evaluation method. Vehicle detectors that are installed in the field were evaluated using the traditional assessment methods and the developed method. As a result, for traditional assessment methods, it was found that evaluation criteria are acceptable, while developed method's criteria are not acceptable. This means that traditional assessment methods do not sufficiently consider errors in measurement, so it has potential to over-estimate for performance of evaluation equipment. On the other hand, it was represented that the developed method should include variable factor such as errors in measurement and more precise compared to traditional assessment methods.

• Journal of Information Technology Services
• /
• v.10 no.4
• /
• pp.171-189
• /
• 2011

KAs information and knowledge are increasingly becoming more important in the knowledge-driven society, knowledge management, as a very important management paradigm, is securing firm position in private and public sectors. Complying with this paradigm, government-funded research institutes in science-technology sector are actively utilizing knowledge management by employing knowledge management system and evaluating its applications' performance. The purpose of this study is to develop evaluation items and measurement indices to rationally measure knowledge management performance of the government-funded research institutes and to verify the feasibility of applying these evaluation items and indices. To achieve this research goal, the evaluation model of knowledge management performance was constructed by reviewing and integrating the existing studies, and subsequently, evaluation areas, evaluation items, measurement indices were derived from this evaluation model. Also, the feasibility analysis on the evaluation items and measurement indices was performed by means of FGI(Focus Group Interview) with the knowledge management experts belonging to Korean government-funded institutions in science-technology sector. The implications of this study are as follows : in theoretical perspective, this study has proposed a criterion frame to evaluate knowledge management performance, and has rationally drawn evaluation items and measurement indices from the criterion frame. And in practical perspective, this study has improved the validity and practicality of the measurement indices, which can lead to more reasonable and easier evaluation of knowledge management performance of the government-funded research institutes.

• Journal of Korean Society for Quality Management
• /
• v.27 no.3
• /
• pp.94-112
• /
• 1999

It is booming to use computer and information owing to the information society. As software applications have grown, so too has the importance of software quality. Therefore, software quality measurement and evaluation are necessary to satisfy the users who are using computers. The ISO/IEC 9126 defines six quality characteristics and twenty-one subcharacteristics including forty inter quality characteristics. We developed software measurement and evaluation technique using the check list in accordance with the ISO/IEC 9126 in design phase. We applied idea and concept of Total Quality Management in order to evaluate and measure the quality of software. Namely, it is the concept such as "you should do it right the first time." or "you have to build quality in the process." We executed the quantitative evaluation of software, also had shown the distinctive result in order that users and developers can find the errors easily. We evaluated the quality of academic softwares in order to verify developing technique at S college. As a result of the evaluation, this college has found it necessary to maintain the software as soon as possible because academic systems are not adequate for users at this present time.

• International Journal of Computer Science & Network Security
• /
• v.22 no.8
• /
• pp.7-14
• /
• 2022

This study aimed to test the factor structure of the measure of student participation in distance education. The study population consisted of all teachers in public education and faculty members in higher education in the Kingdom of Saudi Arabia by applying it to a sample of bachelor's and graduate students at the college of Education at umm al-Qura University. The (ESE) was applied to a random sample representing the study population consisting of (216) respondents. The results of the study showed that the scale consists of three main factors, with showed a high degree of construct validity through fit indices of the confirmatory factor analysis. The results have shown a gradual consistency of the measure's invariance that reaches the high level of the Measurement Invariance across the gender and study groups variables.

• Journal of Korean Institute of Industrial Engineers
• /
• v.24 no.2
• /
• pp.211-221
• /
• 1998

It is very important to have a satisfactory measurement system, since it is useless to try to improve the manufacturing process without an adequate measurement system. Therefore, evaluation of the measurement system is the first step for the quality improvement of the manufacturing process. To estimate the measurement error we must conduct a controlled gage repeatability and reproducibility(gage R&R) study. Many manufacturers use a gage or instrument to measure multiple dimensions for the overall quality of the manufactured parts. In this case, it is necessary to estimate the gage R&R for multiple dimensions. When a gage measures a large number of dimensions of a part, it is very time-consuming and costly to measure all the dimensions. In this paper we propose the use of the principal component analysis method to identify a few principal components out of the original multivariate measurement capability to explain most of the measurement system variation pattern.

• Journal of Korean Institute of Industrial Engineers
• /
• v.30 no.1
• /
• pp.36-43
• /
• 2004

In-line measurement systems are preferred to those in analytical laboratories, since in-line systems provide rapid response to process upsets. If an in-line measurement system exhibits an unstable variation and if this instability in measurement variation goes undetected, it will make the process monitoring procedure invalid. This paper presents a stability evaluation procedure for the in-line measurement system using two independent readings from the in-line measurement system and one reading from the analytical laboratory, which requires less measurement cost and time.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.5 no.1
• /
• pp.15-23
• /
• 2002

Uncertainty components and evaluation of the system of pressure measurement are presented in this paper. Since early in 1980s, measurement uncertainty is getting more important due to ISO/IEC 17025, which is established for international test and calibration laboratories. Up to now it is true that accuracy, precision, error and etc. have been commonly used in industry to define the amount of error to the products and equipment, but these terms ought to be united into uncertainity in the future. This paper describes how to indicate measurement uncertainty and types of measurement errors, and then shows the evaluation result of measurement system using piezoelectric pressure transducers.

• International Journal of Computer Science & Network Security
• /
• v.21 no.5
• /
• pp.243-255
• /
• 2021

This study aimed to identify the effectiveness of the use of distance-evaluation tools and methods among students with learning difficulties from the teachers' point of view, to achieve this goal. A scale was built, and the psychometric characteristics were validated. It consisted, in its final form, of 17 items distributed on four axes, in addition to three open questions. It was applied to a random sample of (149) teachers of students with learning difficulties in Makkah Region. The results showed that teachers' keenness to encourage students with learning difficulties, so that they would not feel frustrated with the distance learning process. It was also evident that teachers did not use achievement portfolios in the evaluation process. In connection with the appropriate evaluation methods, the majority indicated the use of work sheets and visual evaluation methods that rely on audio and visual skills, such as presenting videos, pictures, audio and games, and applying short objective tests. Among the proposals to improve evaluation methods and tools: Individual evaluation, attention to individual treatment, obligating personal attendance of students to school, splitting the required tasks, and not increasing the skills required to be mastered. As for the obstacles that teachers face: Lack of time, difficulty in communicating with students with distance learning difficulties and problems related to the Internet such as interruption, weakness, or lack of availability.

• Journal of Information Technology Services
• /
• v.10 no.2
• /
• pp.141-162
• /
• 2011

The controls of Information Systems (IS) have been an more critical issue controls as the sophistication and integration of IS is more proceeded. ITGI (The Information Technology Governance Institute) of ISACA (Information Systems Audit and Control Association) has suggested COBIT (Control Objectives for Information and related Technology) and this has been widely recognized the evaluation model of IS controls. In COBIT, IS was evaluated in terms of process, information quality, and IT resources. This study used COBIT in order to suggest and empirically test an evaluation model of IS service. The data was collated from one major Chinese SI (Systems Integration) company in four domains of processes : planning and organization, acquisition and implementation, delivery and support, and monitoring. Seven factors are extracted using an exploratory factor analysis as follows : Overall IT planning process, technological assessment process in IT planning of IT, cost-benefit assessment process in IT planning, implementation process, support process, monitoring process, post-implementation evaluation process. The results of confirmatory analysis of three alternative measurement models indicated that the measurement model with one inherent or conceptual variable has greater model fitness than the other models. This study suggests the logical and general way to test and apply COBIT in evaluating IS services.