• Title/Summary/Keyword: Evaluation framework

Search Result 1,570, Processing Time 0.073 seconds

A Study on Development of Problems for Descriptive Evaluation in Grade 7 Mathematics (중학교 1학년 수학과 서술형 평가문항 개발 연구)

  • Noh, Sun-Sook;Kim, Min-Kyeong;Cho, Seong-Min;Baek, Hae-Jin
    • The Mathematical Education
    • /
    • v.47 no.4
    • /
    • pp.487-503
    • /
    • 2008
  • In this paper, descriptive assessment method for middle school mathematics was evaluated by developing a framework for designing and grading problems for descriptive assessment and analyzing the effectiveness of the problems. The new descriptive assessment problems were developed by reviewing the current 7th National Mathematics Curriculum of Korea and aligned mathematics textbooks to define a set of problem design principles and evaluation framework for the assessment strategy. The developed problems were first pilot tested and then revised based on the feedback from the test. The final version was field tested by 100 students in 7th grade middle school. After the field test, the problems were graded by two middle school math teachers and one math education researcher to determine the overall correlation between graders and also to analyze effectiveness of the evaluation framework of the test. This result of this study is expected to assist in the further development of descriptive problems and grading framework by providing a reference work for teachers to better understand the process and the limitations of executing the new assessment strategy.

  • PDF

A Simulation Model Construction for Performance Evaluation of Public Innovation Project

  • Koh, Chan
    • 한국디지털정책학회:학술대회논문집
    • /
    • 2006.06a
    • /
    • pp.87-109
    • /
    • 2006
  • The purpose of this paper is to examine the present performance evaluation methods and to make Monte Carlo Simulation Model for the IT-based Government innovation project. It is suggested the proper ways in applying of Monte Carlo Simulation Model by integration of present evaluation methods. It develops the theoretical framework for this paper, examining the existing literature on proposing an approach to the key concepts of the economic impact analysis methods. It examines the actual conditions of performance evaluation focusing on the It-based Government Innovation project. It considers how the simulation model is applied to the performance management in the public innovation project focusing on the framework, process and procedure of performance management.

  • PDF

Exploring the Evaluation Framework of Maker Education (메이커교육(Maker Education) 평가틀(Evaluation Framework) 탐색)

  • Kang, Inae;Yoon, Hyea Jin
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.11
    • /
    • pp.541-553
    • /
    • 2017
  • Maker education rooted on Maker Movement refers to constructivist learning approach in which students as makers participate in producing visible outcomes through self-directed inquiry and creative hands-on activities in a real life context to solve their personal or social problems. The Maker education, therefore, stresses cultivation of 'maker mindset' in the process-oriented learning environments, pursuing evaluation aspects different from those in the existing educational system. In this context, this study aimed to explore an evaluation framework for the Maker education which reflects the Maker mindset: First, a literature review was conducted to search for the evaluation framework of the maker education which consists of the category of 5 ONs (Minds-on, Hands-on, Hearts-on, Social-on, Acts-on) representing intellectual, physical, emotional, interpersonal and practical aspects, respectively; Second, a Delphi survey for content validity was carried out to confirm the adequacy of the 5 ONs category along with sub-elements for each category. Finally, this study presented the evaluation framework for the Maker education, which is expected to be used as feedback rather than a measuring tool for the process and environments of the Maker education.

Strategic Framework for Website Evaluation based on a Review of Tourism and Hospitality Literature from 2010-2023

  • Xiaonan Li;Dave C. F. Chan;Rob Law
    • Journal of Smart Tourism
    • /
    • v.3 no.3
    • /
    • pp.17-27
    • /
    • 2023
  • This study examines the scientific publications on website evaluation in hospitality and tourism from 2010 to 2023 through a systematic review and discusses implications for future research. The reviewed literature from publication years, journals, research methods, website-related stakeholders, context, various forms of Internet presence (Internet forms), and theories are analyzed to create a comprehensive website evaluation dimension. Furthermore, a conceptual framework is developed to show the relationship between the website characteristics, stakeholders-channels interaction, and stakeholders' reactions. The proposed website evaluation framework in hospitality and tourism synthesizes the existing knowledge, identifies gaps, and further advances our understanding of this research area.

A Design-Decision Support Framework for Evaluation of Design Options in Passenger Ship Engine Room

  • Kim, Soo-Woong;Lee, Hyun-Jin;Kwon, Young-Sub
    • Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
    • /
    • 2006.11a
    • /
    • pp.277-280
    • /
    • 2006
  • Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision-making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. However, the objectives of maximising the degree of technical performance, maximising the safety levels and minimising the costs incurred are usually in conflict, and the evaluation of the technical performance, safety and costs is always associated with uncertainties, especially for a novel system at the initial concept design stage. In this paper, a design-decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. It is a Multiple Attribute Decision-Making (MADM) or Multiple Criteria Decision Making (MCDM) framework, which provides a juxtaposition of cost, safety and technical performance of a system during evaluation to assist decision makers in selecting the winning design/procurement proposal that best satisfies the requirement in hand. An illustrative example is used to demonstrate the application of the proposed framework.

  • PDF

Designing the Framework of Evaluation on Learner's Cognitive Skill for Artificial Intelligence Education through Computational Thinking (Computational Thinking 기반 인공지능교육을 통한 학습자의 인지적역량 평가 프레임워크 설계)

  • Shin, Seungki
    • Journal of The Korean Association of Information Education
    • /
    • v.24 no.1
    • /
    • pp.59-69
    • /
    • 2020
  • The purpose of this study is to design the framework of evaluation on learner's cognitive skill for artificial intelligence(AI) education through computational thinking. To design the rubric and framework for evaluating the change of leaner's intrinsic thinking, the evaluation process was consisted of a sequential stage with a) agency that cognitive learning assistance for data collection, b) abstraction that recognizes the pattern of data and performs the categorization process by decomposing the characteristics of collected data, and c) modeling that constructing algorithms based on refined data through abstraction. The evaluating framework was designed for not only the cognitive domain of learners' perceptions, learning, behaviors, and outcomes but also the areas of knowledge, competencies, and attitudes about the problem-solving process and results of learners to evaluate the changes of inherent cognitive learning about AI education. The results of the research are meaningful in that the evaluating framework for AI education was developed for the development of individualized evaluation tools according to the context of teaching and learning, and it could be used as a standard in various areas of AI education in the future.

Efficient Development and Quality Evaluation of Online Library System using Framework (프레임워크 기반 온라인 서재 시스템의 효율적인 구현 및 품질 평가)

  • Park, Yoon-Young;Byun, Hae-Won
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.5
    • /
    • pp.627-640
    • /
    • 2010
  • In a web 2.0 environment, as a wide range of web services are being utilized, it requires quick and convenient way to develop web applications. For this purpose, the framework has been recently introduced and has been applied to web applications. However, software quality application model has not been presented for the web application using framework. In this paper, we develop web application, online library system using a number of frameworks. The system allows users to freely share book information. In order to evaluate the system, we present new software quality evaluation model for web applications using framework. The five quality attributes, functionality, usability, efficiency, maintainability, stability are defined based on the international standard for software quality evaluation, ISO/IEC 9126-2. We also propose the evaluation metrics for the web application using framework and perform quantitative evalzuation for the online library system.

Ontology Modularization Evaluation Framework (온톨로지 모듈화 평가 프레임워크)

  • Oh, Sun-Ju
    • Journal of Intelligence and Information Systems
    • /
    • v.16 no.1
    • /
    • pp.1-16
    • /
    • 2010
  • Several techniques and methods for ontology modularization have been proposed recently. However, there are few ontology evaluation frameworks to evaluate these techniques and methods. Most researches on ontology modularization have not been focused on ontology modularization evaluation but ontology modularization process itself. In this paper, we devise a novel ontology modularization evaluation framework to measure the quality of ontology modules, logical integrity during modularization process and modularization tools. Experiments were conducted to validate the proposed framework. Three representative modularization approaches SWOOP, Prompt, and PATO were chosen and used to partition or extract modules from an ontology. Then the proposed evaluation framework is applied to these modules. The experiment results indicate that the modularization framework works well. The proposed framework would help ontology engineers improve ontology module quality, anticipate and reduce future maintenance as well as help ontology users to choose ontology modules that best meet their requirements.

A Study on the Development of Evaluation Framework for Public Portal Information Services (공공포털의 정보서비스 평가 프레임웍 개발에 대한 연구)

  • Kim, hye-sun;Shin, ki-jeong;Choi, hee-yeoun
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2007.11a
    • /
    • pp.440-444
    • /
    • 2007
  • This study aimed to develop an evaluation framework for public portal and private portal through user's perception survey. In order to specify the evaluation framework, this study chose yesKISTI and Google as a public portal and a private portal respectively. This study reviewed previous studies to develop indicators to evaluate of public and private portals and developed a framework to provide new services for public portals.

  • PDF

A Utility Evaluation Framework of Blockchain Services using a MCDM (다중의사결정모델을 이용한 블록체인 서비스 효용 평가 프레임워크)

  • Kwang-Kyu Seo
    • Journal of the Semiconductor & Display Technology
    • /
    • v.23 no.2
    • /
    • pp.45-49
    • /
    • 2024
  • Blockchain has gone beyond the proof-of-concept level and is converging with various industries and fields, moving toward the service development and commercialization stage. However, although various blockchain technologies and services are emerging, their development is quite slow and their widespread application to various industries is difficult. Accordingly, it is necessary to identify areas with high introduction utility when applying blockchain services in actual industries and to develop a method to evaluate the utility of blockchain services for this purpose. This paper proposes a framework for evaluating the utility of blockchain services using a multi-criteria decision-making model. Through a case study on the utility evaluation of blockchain services, the proposed framework was applied to domestic and foreign blockchain services to evaluate its utility and verify its applicability. It is expected that the proposed framework will be able to identify industrial and functional characteristics where actual blockchain services can be introduced and demonstrate effective utility and can be used to develop blockchain services in various industrial fields.

  • PDF