• Journal of the Ergonomics Society of Korea
• /
• v.18 no.3
• /
• pp.55-72
• /
• 1999

Evaluation of user interfaces has to be performed in an intuitive and subjective manner by experts especially when the problem comes to the complexity and consistency of sophisticated interface procedures. The manual analysis and evaluation of logical interfaces also tends to be slow and laborious. To make the evaluation more formal and objective, the criteria and the procedure with which the evaluation can proceed must be explicitly prescribed. Furthermore, to make the formal procedure as practical as subjective expert evaluation, the criteria must reflect the user knowledge of the target tasks since the task knowledge plays the role of a basis for users to understand the interface organizations and procedures. This paper describes ESTIM, a support system for task-based evaluation of user interface, that includes the interface evaluation criteria and implies an evaluation procedure. The support system can be used either in an interactive manner by the analyst during the evaluation or in an automatic evaluation mode. It was verified that the result of automatic evaluation by ESTIM matched the results of expert evaluation fairly well.

• Educational Technology International
• /
• v.12 no.2
• /
• pp.47-70
• /
• 2011

The purpose of this paper was to develop evaluation procedures for blended instruction, focusing on the courses that are currently offered in the university. This study analyzed current evaluation procedures and instruments and suggested redesign the evaluation process for blended instruction. The evaluation procedures are designed based on the combination of objective-oriented and consumer-oriented evaluation approaches. It includes three stages: front-end (screening), formative evaluation, and summative evaluation. During the front-end evaluation stage, information regarding students' technology skills and attitudes towards online instruction and classroom instruction are suggested to collect and plan the instructional strategies accordingly. The formative evaluation is conducted during the semester to collect students' opinions about the course and instructors modify their instruction based on the evaluation results. At the end of semester, summative evaluation is to be conducted to collect the data to improve the course. Evaluation questions and components for each stage are developed to collect the data such as students' perceptions of the course, the usefulness of online instructional materials, the effectiveness of blended learning strategies, and students' satisfaction with the course.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.6 no.3
• /
• pp.191-201
• /
• 2010

The Korean central government has been investing a lot of efforts to promote performance of local governments. For example, the Ministry of Public Administration and Security (MOPAS) supported the local governments to develop and provide with a 'balanced score card' and a 'customer satisfaction innovation. ' Many other central ministries also conducted individual evaluations for local governments in their substantive policy areas. These evaluation systems of 78 appraisals for local governments conducted by the MOPAS and other ministries had made the local governments to work harder. However, most local governments have appealed their 'reform fatigue' caused by the overlapping evaluation systems. In this context, the MOPAS initiated merging the evaluations into a co-evaluation system under the new Government Performance Evaluation Act of 2006. In this process of introduction of new evaluation system, there are two significant movements. Firstly, as Korean Government has strong information technology, MOPAS has developed 'Virtual Policy Studio (VPS)' which evaluates the performance of each local government with on line. In other words, in the co-evaluation system for local government performance most evaluation steps are implemented by computer and Internet. So most stakeholder can access and work on the VPS in real time when they want to. And the other thing is that cooperation among stakeholders has been occurred in the co-evaluation system. Furthurmore the cooperative governance is systemized and sustain for a long time because MOPAS made IT based co-evaluation system. Therefore this paper intends to illustrate the process of introduction of VPS, main process of co-evaluation system based on VPS and analyze collaborative governance of the co-evaluation system.

• Convergence Security Journal
• /
• v.4 no.2
• /
• pp.71-75
• /
• 2004

The Common Criteria (CC) philosophy is to provide assurance based upon an evaluation of the IT product or system that is to be trusted. Evaluation has been the traditional means of providing assurance. It is essential that not only the customer' srequirements for software functionality should be satisfied but also the security requirements imposed on the software development should be effectively analyzed and implemented in contributing to the security objectives of customer's requirements. Unless suitable requirements are established at the start of the software development process, the re suiting end product, however well engineered, may not meet the objectives of its anticipated consumers. By the security evaluation, customer can sure about the quality of the products or sys tems they will buy and operate. In this paper, we propose a selection guide for If products by show ing relationship between security engineering and security evaluation and make help user and customer select appropriate products or system.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.24 no.3
• /
• pp.13-26
• /
• 1999

Recently, information technology and information system(IS) are rapidly diffused throughout the world. In the global competitive environment, the success of IS becomes the important one among the critical success factors(CSF) of the firm. For achieving it, the firm must continually involve itself in the quality evaluation and improvement of IS. The quality concept was changed into the customer-oriented quality one. There is no exception to the quality of IS. In the past, IS quality was determined by the IS developer or IS department offering service. Now it is evaluated by the user of IS service, and then the customer-oriented user satisfaction becomes an important issue. The purpose of this study is to develope the total quality evaluation model of IS through TQM approach. First, all success factors of the domestic IS are extracted from the foreign and domestic literatures of IS success factors contained the technical and behavioral aspects. And the extracted factors are classified with evaluation levels for quality evaluation and developed into a total quality evaluation model. Finally the model usefulness is analyzed.

• International Journal of Safety
• /
• v.6 no.2
• /
• pp.33-37
• /
• 2007

In recent days, the accidents have happened at experimental laboratories in universities or institutes. In order to improve safety assurance of workers in laboratories, it is required to carry out systematic study concerned with evaluation of safety and health level. The safety and health inspection checklists were developed and conducted the case study. The case study was carried out laboratory safety inspection with 5 inspectors by the checklists to become aware of safety and health level. From the evaluation results of the inspection, we could be made quantification of laboratory through evaluation of safety and health level in laboratory. It was found that was recognized present states of the laboratory and established a plan for improvements in laboratory safety facilities from the case study. The safety inspection checklists can be used as basic data to establish evaluation criteria of safety and health level.

• Magazine of the Korean Society of Agricultural Engineers
• /
• v.45 no.6
• /
• pp.96-108
• /
• 2003

Agricultural water occupies the largest portion of total water use in Korea, and generally researches on the development of agricultural water have been stressed on the demand of agricultural water itself. But it is unavoidable to change a policy from the development of water resources to cope with the increase of water demand to the effective management of existing water resources. Evaluation of the decrepitude of irrigation facilities and their reasonable maintenance are important for the effective supply and use of agricultural water. Therefore it is necessary to develop evaluation technique that diagnoses the current condition of irrigation canals and suggest a countermeasure to improve the found problems. 25 items in 6 classes were selected for the evaluation of irrigation canal systems, and the weighted value between the items was calculated using AHP (Analysis Hierarchy Process) method. The current condition of the irrigation facilities was evaluated from the class evaluation marks, and ranking was decided from the total marks between the projects, and finally the priority of the project for the improvement was given.

• Journal of the Korean Society for Heat Treatment
• /
• v.13 no.3
• /
• pp.163-169
• /
• 2000

Recently, uncertainty of hardeness became a major concem for the people working on the laboratory evaluation and accreditation. It is required to indicate uncertainty of hardness tester on the report after calibration. In addition to this, uncertainty of certified hardness reference block is also required to indicate on the certification sheet. Method on the evaluation of uncertainty in hardness measurement is agreed only recently for Rockwell hardness C scale. In this paper, a preliminary calculation of uncertainty based on type B evaluation has been made for hardness testers which satisfies the requirements of Korean Standards. It was found that the tolerance limit of mean value specified in KS should be increased to be compatible with the calculated uncertainty.

• Proceedings of the KSR Conference
• /
• 2004.10a
• /
• pp.1731-1736
• /
• 2004

The purpose of this article is to introduce a useful methodology of effective goal-setting for the team-level units. As a way to overcome some common symptoms in terms of Strategic Performance Evaluation System such as lack of knowledge on goal-setting, disconnection of process, problem of judging the degree of difficulty about objectives, limits of staff departments evaluation, fairness and authority of evaluators, weakness in coaching technique, and quantity or figure-oriented evaluation, to name a few, and to seek a more plausible goal-setting methodology, the author suggests a persuasive goal-setting concept: VAR(Value-Added Results). VAR, as the end-results, is the team contributions that add value to the organization, and it results from the team's activities. In addition to these goal-setting technique based on the concept of value-added results, several aspects should be improved for Strategic Performance Evaluation System to be implemented more effectively. They are: 1) shift from MBO to MP & D(Managing Performance & Development), 2) impartial exercise of evaluation authority as a organizational public assets, 3) reinforcement of maternal leadership and servantship instead of paternal leadership, 4) utilization of IT-based evaluation system.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2023.05a
• /
• pp.329-330
• /
• 2023

The performance of the construction project is to be evaluated within 60 days of completion, according to relevant laws. It evaluates cost, construction period, design change, re-construction, safety, etc. for each project stage. And the project owners are inputting the evaluation results of the construction work into the construction project information system(CALS). The post-evaluation result information entered in this way can be referred to in the basic design of the construction project by referring to the related contents if there is a similar construction in the future. And It can also be used to predict and respond to the required period and cost by analyzing the accumulated data. In this study, in order to provide reference data that can be used in similar projects in the future, the latest analysis methods are reviewed and the possibility of future application is considered. Accordingly, this study intends to focus on the construction cost part among the indicators such as construction cost, construction period, design change, and re-construction that are currently being dealt with in post evaluation.