• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.11 no.5
• /
• pp.1708-1715
• /
• 2010

This paper proposes an object-oriented software development guidance and an evaluation index for the productivity related to Seam Framework. Heavyweight and lightweight architecture to resolve the problem with benefits to support the new architecture is a large size distributed object standardization architecture. This architecture, such as the Seam Framework, to provide all of the architecture is possible. The distributed object standardization architecture is most often used in business Seam Framework is well-known architecture. Therefore, this study is based on the Seam Framework large distributed object architecture, design and implementation of JPetStore order system based standardization software development productivity and the objective is to provide guidance.

• International Commerce and Information Review
• /
• v.9 no.2
• /
• pp.231-253
• /
• 2007

This paper intends to develop an performance evaluation framework of e-trade. The Korea e-trade has been largely attracting many research communities because it brings about e-trade platform which is happening at the early stage of information system maturity. It is true that many research works have been focusing on development issues in e-trade but not much works have been done in e-trade performance study. This paper suggests an e-trade performance framework based on both field and literatures surveys. In addition, an factor analysis model has been introduced to determine that the suggested factors are empirically supporting the hypotheses in the model. Since this paper is opening up many research issues in e-trade performance study many research group could participate in this research area.

• International Journal of Computer Science & Network Security
• /
• v.23 no.2
• /
• pp.39-46
• /
• 2023

The purpose of this study is to introduce a proposed Framework for Evaluating the Return on Investment (ROI) of E-Learning Programs at Saudi Universities. To achieve this goal, the descriptive analysis methodology is used to analyze the literature review about e-learning and its evaluation from different viewpoints, especially from the ROI-related perspective. As well as the literature reviews related to ROI and the methods of calculating it inside society institutes. This study suggests a conceptual framework for evaluating the ROI of E-Learning Programs at Saudi Universities. This framework is based on the merging process among the analyze, design, develop, implement, and evaluate (ADDIE) model for designing e-learning programs, which gives detailed procedures for executing the program, several evaluating models for e-learning, and the Kirkpatrick model for evaluating the ROI of e-learning. It consists of seven stages (analysis, calculating the costs, design, development, implementation, calculation of the benefits, and calculation of the final ROI).

• ETRI Journal
• /
• v.46 no.1
• /
• pp.106-117
• /
• 2024

Large language models (LLMs) have revolutionized various applications in natural language processing and exhibited proficiency in generating programming code. We propose a framework for evaluating the code generation ability of LLMs and introduce a new metric, pass-ratio@n, which captures the granularity of accuracy according to the pass rate of test cases. The framework is intended to be fully automatic to handle the repetitive work involved in generating prompts, conducting inferences, and executing the generated codes. A preliminary evaluation focusing on the prompt detail, problem publication date, and difficulty level demonstrates the successful integration of our framework with the LeetCode coding platform and highlights the applicability of the pass-ratio@n metric.

• Journal of Korea Society of Industrial Information Systems
• /
• v.13 no.5
• /
• pp.158-167
• /
• 2008

In recent years, various information technologies including ubiquitous computing technology have been developed and deployed. The more ubiquitous services based on ubiquitous technology have widely been spread, the more evaluation methods of those services are required. In this study, we suggest a framework for evaluating ubiquitous services by identifying evaluation factors and their relative importances. Combining review of related works and experts' opinions on the evaluation, we calculate the factors affecting ubiquitous service evaluation and relative importances among those factors using fuzzy Analytical Hierarchy Process (AHP). We conduct a case study to illustrate the applicability and feasibility of the suggested framework.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.10a
• /
• pp.249-251
• /
• 2021

PBFT (Practical Byzantine Fault Tolerant) is a consensus algorithm that guarantees higher processing speed compared to PoW (Proof of Work) and absolute finality that records are not overturned due to the superiority of computing power. However, due to the complexity of the message, there is a limit that the network load increases exponentially as the number of participating nodes increases. PBFT is an important factor in determining the performance of a blockchain network, but studies on evaluation metrics and evaluation technologies are lacking. In this paper, we propose a PBFT evaluation framework that is convenient to change the consensus algorithm to easily evaluate quantitative indicators and improved methods for evaluating PBFT.

• Journal of Information Technology Applications and Management
• /
• v.26 no.5
• /
• pp.13-25
• /
• 2019

Recently, as evaluation of information security (IS) management become more diverse and complicated, the contents and procedure of the evidence to prepare for actual assessment are rapidly increasing. As a result, the actual assessment is a burden for both evaluation agencies and institutions receiving assessments. However, most of them reflect the evaluation system used by foreign government agencies, standard organizations, and commercial companies. It is necessary to consider the evaluation system suitable for the domestic environment instead of reflecting the overseas evaluation system as it is. The purpose of this study is as follows. First, we will present the problems of the existing information security assessment system and the improvement direction of the information security assessment system through analysis of existing information security assessment system. Second, it analyzes the technical guidance for information security testing and assessment and the evaluation of information security management in the Special Publication 800-115 'Technical Guide to Information Security Testing and Assessment' of the National Institute of Standards and Technology (NIST). Third, we will build a framework to implement the evidence collection system and present a system implementation method for the '6. Information System Security' of 'information security management actual condition evaluation index'. The implications of the framework development through this study are as follows. It can be expected that the security status of the enterprises will be improved by constructing the evidence collection system that can collect the collected evidence from the existing situation assessment. In addition, it is possible to systematically assess the actual status of information security through the establishment of the evidence collection system and to improve the efficiency of the evaluation. Therefore, the management system for evaluating the actual situation can reduce the work burden and improve the efficiency of evaluation.

• IE interfaces
• /
• v.22 no.3
• /
• pp.192-204
• /
• 2009

Based on the characteristics of 'Korean electric power industry R&D programs', this study proposes a new performance evaluation framework where electric power industry related R&D projects are scrutinized. The abovementioned R&D programs have their own goals and especially they emphasize the effectiveness as well as the efficiency of each subordinate R&D project. Hence, in this framework, a performance evaluation procedure is established and then a mathematical model is developed according to the procedure. The model calculates performance evaluation indices for a set of R&D projects integrating the effectiveness with the efficiency of each R&D project. In a case study with an empirical dataset, statistical significance is tested on the integrated performance evaluation indices of R&D projects regarding organizational types and program categories considered.

• The Mathematical Education
• /
• v.58 no.4
• /
• pp.507-518
• /
• 2019

The OECD launched the Education 2030 project to develop a learning framework and to conduct the international comparative study on curriculum. As a part of the OECD international curriculum analysis, Korea Institute for Curriculum and Evaluation(KICE) conducted a main study of Curriculum Content Mapping (hereafter, CCM) in the 7 learning areas/subject areas such as national languages, mathematics, humanities/social sciences, natural science, physical education/health, arts, and technologies. The CCM study aimed to identify how the competencies on CCM framework were reflected in the Korea curriculum. For this purpose, KICE identified the competencies on CCM framework, revised the coding framework, and undertook the mapping process. In this study, we gathered the CCM data as an evidence of how competencies on CCM framework were embedded in the 2015 revised mathematics curriculum. For this purpose, experts in mathematics education undertook the mapping process, we summarized the results of CCM main study in mathematics. As the results, numeracy, critical thinking, problem solving, anticipation, action, reflection were perfectly embedded in the 2015 revised mathematics curriculum. the competencies on CCM framework were embedded in the 2015 revised mathematics curriculum, and but literacy, physical/health literacy, trust, learning to learn, reconciling tension and dilemmas, literacy for sustainable development, financial literacy, and entrepreneurship/enterprising were not clearly related to mathematics curriculum. The mapping results should help the Korea Ministry of Education and KICE for preparing the future curriculum revision and development.

• Journal of Korean Society of Forest Science
• /
• v.105 no.4
• /
• pp.472-485
• /
• 2016

The main purpose of this research was to develop a multi-level evaluation framework for the management effectiveness of the Forest Genetic Resources Reserve (FGRR) at both the system level and the site level. The initial system level Management Effectiveness Evaluation (MEE) framework for FGRR was developed based on the MEE Framework designed by IUCN WCPA and MEE framework for Korean National Parks that was designed jointly by IUCN, the Korean Ministry of Environment, and the Korea National Park Service. Several indicators were added or modified considering characteristics of the FGRR. The final system level MEE frameworks consisted of 6 categories with total of 39 criteria and 42 indicators based on expert survey results. The initial site-level MEE framework was developed based on the site level MEE framework for Korean National Parks that was designed jointly by IUCN, the Korean Ministry of Environment, and the Korea National Park Service. The final site level MEE framework consisted of 6 categories with total of 16 criteria and 40 indicators based on both an expert survey and an intensive workshop with the officers in charge of managing the FGRR from the Korea Forest Service and local governments.