• Journal of The Korean Association For Science Education
• /
• v.38 no.3
• /
• pp.355-367
• /
• 2018

The purposes of this study are 1) to identify systems thinking level and definition, 2) to develop a framework for the assessment of systems thinking level, and 3) to develop a rubric for scoring open-ended written responded test. In order to achieve these purposes, a total of 60 articles were analyzed by using the literature analysis framework. The systems thinking level and definition are identified through the results of systems thinking literature analysis. Based on the systems thinking level and definitions, the research derived a framework that includes the core ideas and evaluation content of each level. In addition, rubric for the scoring of open-ended response test items was revised and supplemented. It is concluded that a content validity test on the tools (systems thinking level and definition, framework for item development, rubric) has been developed in the study. The content validity was verified by 7-science education experts. According to the result of CVI, it was found to be more than .95 in all three tools. Based on the results of this study, the research will develop items that can measure students' level of systems thinking. The construct validity and criterion validity of the developed items should be verified systematically. The research could carry out a validation study for the systems thinking measurement related to the core competence emphasized in the 2015 revised curriculum.

• Journal of the Korean Society for information Management
• /
• v.35 no.3
• /
• pp.271-286
• /
• 2018

The purpose of this study is to measure the outcomes of a program provided by a public library using the evaluation framework based on Logic Model. A reading program for children which was operated by a public library in Seoul was selected. The outcome evaluation was started with the analysis of the reading program process including planning, operation, and evaluation. Based on the analysis, a logic model framework for outcome evaluation was developed. For evaluation, user, bibliography, and circulation data were collected from the library KOLAS system. Additionally, the participant information were extracted from the final report drafted after the program. The research results show that the number of circulation of program participants was increased after the program. In addition, the range of reading topic was expanded. These findings indicate that the reading program is an effective program for promoting children's reading habit and that outcome evaluation might be a valid tool to measure the effectiveness of public library programs.

• Journal of the Korean Society of Environmental Restoration Technology
• /
• v.6 no.4
• /
• pp.8-16
• /
• 2003

In terms of climate change communities have only during the 1990s begun to recognize that all greenhouse gas(GHG) emissions are directly or indirectly generated locally, through acts of agency, production or consumption. This has provided a boost to the role of local places in the debate since GHGs can be allocated and made understood locally and hence form the basis for specific policies, programs, plans and projects. The objectives of this study are to define a framework for making Environmentally Friendly City through enhancing integrated energy-urban policies and present framework to do comprehensive evaluation on energy related policies response and also explore the interrelation between energy related activities in each sector and policy and applies to Seoul mega city in Korea. Despite the growing recognition of the seriousness of urban environmental problems and their contribution to global environmental and social concerns, most analysts continue to study cities in parts rather than as a whole; we study sectoral sub-systems such as transport, air pollution or energy. While specialization is useful for detailed thinking, we also need to see each issue in the context of how each city works environmentally, economically, socially and politically. We therefore need integrative approaches to study of cities and need to understand how they function as systems. These framework presented in this study allows an organized and systematic analysis. These research results can provide useful, credible and timely input into the urban planning process. This study will be a helpful exercise to draw some policy implications of other cities in Korea and also East Asia that are in a similar stage with the these cities and developing plans on how to address them.

• Journal of Intelligence and Information Systems
• /
• v.14 no.4
• /
• pp.69-87
• /
• 2008

The Web is evolving toward the Semantic Web. Ontologies are considered as a crucial component of the Semantic Web since it is the backbone of knowledge representation for this Web. However, most of these ontologies are still built manually. Manual building of an ontology is time-consuming activity which requires many resources. Consequently, the need for automatic ontology extraction tools has been increased for the last decade, and many tools have been developed for this purpose. Yet, there is no comprehensive framework for evaluating such tools. In this paper, we proposed a set of criteria for evaluating ontology extraction tools and carried out an experiment on four popular ontology extraction tools (i.e., OntoLT, Text-To-Onto, TERMINAE, and OntoBuilder) using our proposed evaluation framework. The proposed framework can be applied as a useful benchmark when developers want to develop ontology extraction tools.

• ETRI Journal
• /
• v.31 no.5
• /
• pp.554-564
• /
• 2009

In information security and network management, attacks based on vulnerabilities have grown in importance. Malicious attackers break into hosts using a variety of techniques. The most common method is to exploit known vulnerabilities. Although patches have long been available for vulnerabilities, system administrators have generally been reluctant to patch their hosts immediately because they perceive the patches to be annoying and complex. To solve these problems, we propose a security vulnerability evaluation and patch framework called PKG-VUL, which evaluates the software installed on hosts to decide whether the hosts are vulnerable and then applies patches to vulnerable hosts. All these operations are accomplished by the widely used simple network management protocol (SNMP). Therefore, system administrators can easily manage their vulnerable hosts through PKG-VUL included in the SNMP-based network management systems as a module. The evaluation results demonstrate the applicability of PKG-VUL and its performance in terms of devised criteria.

• Journal of the Korea Society of Computer and Information
• /
• v.5 no.4
• /
• pp.154-160
• /
• 2000

Recently, there are great variations on concepts and rolls of information system as the radical growth in information technology. A systematic MIS evaluation is requested for effective management and operation of information system. Although many researches on MIS evaluation have been progressed, the evaluation of the user satisfaction is limited by evaluating from the each system's result because of the diversity of view points and inclusion of MIS introduction. Therefore, in this paper, a conceptual framework is suggested to evaluate MIS synthetically that is changed by the result of existing MIS evaluation. So to speak, a new evaluation framework is suggested by synthesizing various view points and evaluation method that suggested from the existing MIS evaluation such as user satisfaction of results as the introduction of MIS and the satisfaction of variation of entire organization.

• Journal of Information Technology Services
• /
• v.8 no.4
• /
• pp.87-101
• /
• 2009

The current information system audit merely inspects a web based information system by focusing on checking items that are extracted from structured and information engineering model and object-oriented component model. As a result, the checking item of web contents and design is inadequate. This paper aims to extract audit framework in order to strengthen the audit of web contents and design during the development of the web based information system and to suggest checking items based on audit framework. For this, the web development process and web site evaluation model were studied, compared, and analyzed with the current information system development audit. From a result of the survey, it was found that the adequacy of the suggested audit framework and audit checking items is above the average value. It is believed that the suggested audit framework is helpful for the audit of web based information system.

• Architectural research
• /
• v.16 no.4
• /
• pp.131-137
• /
• 2014

Recently, the development of sustainable building assessment tools as means to invigorate the dissemination of sustainable buildings has been actively progressed. However, many assessment tools involve various problems in terms of assessment method and system framework, which greatly impede their credibility and applicability. If these problems persist over time, the role of sustainable building assessment tools as decision making measures during the design stage will be greatly limited. The objective of the study is to suggest a systematic model for sus- tainable building assessment tools by establishing a logical system of performance assessment framework. For this purpose, the Environmen- tal Impact Assessment(EIA) framework used in selected and modified to fit the building performance assessment. The analysis of performance assessment tools for sustainable buildings was conducted using the EIA framework. Based on the results of the analysis, a framework for the performance assessment of sustainable buildings was established.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.2
• /
• pp.331-338
• /
• 2011

Objective: The present study developed a comprehensive usability testing and analysis framework based on a physical interface model of product and user and applied the proposed framework to usability testing of canister-type vacuum cleaner. Background: The development of a user-centered product design is important to satisfy customers who want to use the product with ease of use and to keep the manufacturer competitive in the market. Method: The proposed testing and analysis framework consists of (1) characterization of physical product-user interface, (2) preparation and administration of usability testing questionnaire, and (3) analysis and interpretation of usability testing results. A usability evaluation of five vacuum cleaners was planned and administered based on the proposed framework and its analysis produced detailed and overall usability testing results for various aspects such as tasks, usability criteria, and design components. Results: The testing results were further utilized to identify usability problems and preferred design features of the vacuum cleaners. Conclusion: The proposed usability testing and analysis framework was found effective to identify preferred features and problems of a product design in a systematic, holistic manner. Application: The proposed framework can be of effective use for practitioners of product design and development to obtain comprehensive, quantitative usability testing information in a systematic manner.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.29 no.3 s.234
• /
• pp.403-410
• /
• 2005

This study presents the benchmark results of several design frameworks for the purpose of developing an efficient design framework in view of Excel interface. For the benchmark, three optimum design problems are chosen and solved by using the design frameworks. In order to compare the frameworks with each other, the evaluation criteria are specified and modified to fit the problems with Excel interface. Three example cases are solved and compared. The evaluation report is summarized in terms of efficiency, ease of use, internal structure, API, etc. However, the optimization result itself is not focused because the specific optimization algorithm is not our concern. Finally, some suggestions of how to develop an efficient design framework with Excel interface are presented.