• 문화기술의 융합
• /
• 제8권6호
• /
• pp.553-560
• /
• 2022

고등교육기관의 역량 중심 교육과정 운영을 위해서는 교과목 수준에서 교과 학습목표(성과기준)의 성취수준을 다각도로 평가하여 학습자의 역량 함양 정도를 파악하는 교과기반 학습평가 방법에 대한 연구가 지속적으로 필요하다. 본 연구에서는 교과목 학습성과, 학습주제, 학습개념 기반의 학습평가 모델 및 성취수준에 따른 개인화된 학습 피드백 모델을 제안한다. 먼저 데이터 모델링 과정에서 교과목의 계층화된 학습성과, 학습주제 및 학습개념 그래프 및 학습성과-평가 매트릭스 모델을 정의하고 이를 기반으로 학습성과별, 학습주제별, 학습자별 등 다각도의 학습성취 수준을 측정하고 피드백하는 알고리즘을 제안한다. 제안한 학습성취평가 모델의 유효성을 검증하기 위해 자바프로그래밍 교과목에 적용하여 실제 데이터를 기반으로 실험을 진행하였으며 그 결과 성취수준의 산출 및 학습 피드백이 가능함을 보였다.

• 성인간호학회지
• /
• 제26권6호
• /
• pp.653-667
• /
• 2014

Purpose: This study was aimed to develop frequently-used clinical scenarios and scoring rubrics to assess core basic nursing skills in adult health nursing clinical practice for clinical evaluation based on program learning outcomes (PO). Methods: This study was a methodological research combining focus group interviews and questionnaires to select and construct scenarios. Data were collected from clinical practitioners, adult health nursing professors, and new nurses from November, 2013 to April, 2014. The developed scenarios and rubrics were applied to nursing students by way of showing an example. Results: The 12 frequently-used clinical scenarios were developed. The proportion of the evaluation rubrics were 30% for clinical instructors where as 70% for college instructors. In order for students to achieve the important learning outcomes from the courses for clinical practice, four program outcomes (POs) were selected as well as a rubric for each POs was developed. Students who had situation-based clinical practices showed higher levels of satisfaction on mastery of core basic nursing skills and communication skills. Conclusion: This findings of the study suggested the strategies for complementing pitfalls in clinical setting and achieving PO during students' clinical practicum.

• Safety and Health at Work
• /
• 제7권1호
• /
• pp.83-85
• /
• 2016

Effective interventions to reduce work-related exposures are available for many types of work-related diseases or injuries. However, knowledge of the impact of these interventions on injury or disease outcomes is scarce due to practical and methodological reasons. Study designs are considered for the evaluation of occupational health interventions on occupational disease or injury. Latency and frequency of occurrence of the health outcomes are two important features when designing an evaluation study with occupational disease or occupational injury as an outcome measure. Controlled evaluation studies-giving strong indications for an intervention effect-seem more suitable for more frequently occurring injuries or diseases. Uncontrolled evaluation time or case series studies are an option for evaluating less frequently occurring injuries or diseases. Interrupted time series offer alternatives to experimental randomized controlled trials to give an insight into the effectiveness of preventive actions in the work setting to decision and policy makers.

• 공학교육연구
• /
• 제16권3호
• /
• pp.42-50
• /
• 2013

The main purpose of this study was to develop a program outcomes assessment tool using reflection journal. Reflection journal has recently come to gain more attention from school as an alternative assessment tool. Although numerous studies reconfirmed the educational importance and value of reflection journal as an assessment tool, research on the assessment tool of the engineering accreditation, based on education view is scarce. After literature reviews about the case studies on the program outcomes assessment, this study, to analyse the current assessment tools, and then, examined the educational implications of reflection journal as a program outcomes assessment tool. This study suggested the assessment tool using reflection journal for PO6 (teamwork) and PO11 (engineering ethics), one of the most important assessment items in engineering accreditation. In this study, we used the performance criteria, assessment criteria, rubric, and closed the loop to measure the teamwork and engineering ethics. The result of this study is significant in terms of guiding the future evaluation system development for program outcomes.

• 공학교육연구
• /
• 제24권6호
• /
• pp.30-39
• /
• 2021

The present study aims to demonstrate that it is possible to objectively evaluate the competency (referred to as graduate attributes or program outcomes) of graduates of engineering education programs. To strengthen the link between engineering education accreditation and the qualification/certification system of engineering professionals, referred to as K-Engineering Professional (K-EP), individually assuring the quality of accredited graduates using multiple-choice test as main assessment tool is proposed. Test questions related to the basic vocational skills of NCS are developed for seven of the 10 program outcomes of the ABEEK KEC2015. The three program outcomes, PO1, PO3, and PO5, which need to fully accommodate the characteristics of each disciplinary field, are excluded. A pilot test involving graduates of eight accredited programs is conducted. Applying on Rasch model based on Item Response Theory (IRT), the item difficulty, fit and discrimination of multiple choice test are demonstrated. The pilot study strongly suggests that individual competency evaluation is possible at a certain level for seven program outcomes tested. For PO1, PO3, and PO5, however, questions that address the characteristics of each disciplinary field need to be devised. If a suitable pool of questions is built, it can be used as a program outcomes assessment tool by the accredited programs.

• East Asian Economic Review
• /
• 제27권1호
• /
• pp.3-31
• /
• 2023

Dissemination of information can enhance smallholder farmers' agricultural outcomes and incomes in developing countries. However, the impact evaluation for new information can be inaccurate without considering pre-existing information that the indigenous people have used. This study explores qualitative causal links between existing agricultural information used by Lao smallholder farmers on rice yield and selling price with 180 household data. We categorized the pre-existing information into weather, farming technique, input, intermediate trader, and sales price. The source of each piece of information is used as an instrumental variable to overcome the endogeneity issue between information use and agricultural outcomes. Using farming technique information positively affects rice yields by 57.1% compared to those without that information. Moreover, intermediate trader and crop sales information result in 64.5% and 60.0% higher selling prices than non-user groups. A statistically significant causal relationship exists with agricultural outcomes. The more genuine impact should be measured with a newly updated impact evaluation approach that considers this pre-existing agricultural information.

• 정보관리학회지
• /
• 제35권3호
• /
• pp.271-286
• /
• 2018

본 연구는 공공도서관에서 운영하는 프로그램의 성과를 로직모델을 기반으로 개발된 평가 프레임워크를 적용하여 측정하고자 하였다. 성과 측정을 위해 서울 소재 한 공공도서관에서 운영하는 여러 프로그램 중 어린이 독서 프로그램을 선정하였다. 성과 측정 과정은 어린이 독서 프로그램의 계획, 진행, 평가 등의 업무과정 일체를 분석하여 로직 모델을 구현하였으며 이에 의거하여 예상되는 성과를 측정하였다. 데이터는 KOLAS를 통해 회원정보, 서지정보, 대출정보 등을 수집하였고, 프로그램 운영 현황에 대한 데이터는 프로그램 진행 후 작성된 보고서에서 추출하였다. 측정 결과 어린이 독서 프로그램에 참여한 회원들의 대출빈도가 상승하였고, 프로그램의 주제에 따라 대출 장서의 주제가 변화하는 것을 볼 수 있었다. 본 연구를 통해 독서 프로그램이 갖는 효과와 의미를 확인할 수 있었으며, 성과평가가 도서관에서 운영하는 타 프로그램 및 도서관 업무 등의 효과성을 측정하는데 유용한 도구가 될 수 있음을 보여주었다.

• 중환자간호학회지
• /
• 제4권2호
• /
• pp.1-14
• /
• 2011

Purpose: This study was aimed to understand and describe the Korean critical care advanced practice nurses' work experience. Methods: Data was collected through 2 focus group interviews that were held in two different university hospitals in Seoul, Korea. All interviews were recorded and transcribed, and data were analysed using modified qualitative content analysis. Results: Ten themes were drawn from data analysis. They are "Various and complex tasks", "Excellency of advanced nursing practice", "Pressure and responsibility accompanied with pride", "Role identity confusion", "Role conflict", "Leaping and evolving role", "Gap between role and outcome evaluation", "Underestimated outcomes", "Where are my outcomes?" "Searching for outcomes: publicize the role". Conclusion: The results of this study help to understand the role of Korean critical care advanced practice nurses and to guide to outcome evaluation of their role effectiveness. Developing qualitative outcome indicators, cost-effectiveness ananlysis of Korean critical care advanced practice nurses' role, and accumulation of evidences through researches on outcome evaluation will be needed to successfully settle down advanced practice nursing in Korea.

• 한국건축시공학회:학술대회논문집
• /
• 한국건축시공학회 2009년도 춘계 학술논문 발표대회 학계
• /
• pp.143-147
• /
• 2009

Graduates from engineering colleges are demanded to have been acquired some abilities and qualities during their undergraduate years through the standard of the so-called "programmed learning results and evaluation" This paper aims at analyzing the learning results evaluation tool for graduates from the architectural engineering department through the examples of the colleges with engineering accreditation in Korea, and suggesting a more appropriate programmed learning result evaluation tool. The basic theories on programmed learning results were studied, and then the previous study examples were researched. The study objects were limited to the fourteen colleges which offered the examples of the learning results evaluation tools of the colleges with engineering accreditation in Korea. Types and the present situation of those evaluation tools were analyzed. In addition, the proposals for the evaluation tool of programmed learning results and the performance standard were suggested for those with an engineering accreditation, based on the case study of the performance standards of each college with an engineering accreditation. The study results showed that much more national research needs to be conducted to clarify the standards of selecting an evaluation tool and a performance standard appropriate for the level of each college so that it can make a proper proposal.

• Communications for Statistical Applications and Methods
• /
• 제23권4호
• /
• pp.343-353
• /
• 2016

In doubly-censored data, an originating event time and a terminating event time are interval-censored. In certain analyses of such data, a researcher might be interested in the elapsed time between the originating and terminating events as well as regression modeling with risk factors. Therefore, in this study, we introduce a model evaluation method to measure the predictive ability of a model based on negative predictive values. We use a semiparametric estimate of the predictive accuracy to provide a simple and flexible method for model evaluation of doubly-censored survival outcomes. Additionally, we used simulation studies and tested data from a prostate cancer trial to illustrate the practical advantages of our approach. We believe that this method could be widely used to build prediction models or nomograms.