• Title/Summary/Keyword: summative assessment

Search Result 20, Processing Time 0.025 seconds

Secondary School Science Teachers' Actual and Preferred Types of Assessment (중등 과학교사의 과학 평가 실태와 지향)

  • Noh, Taehee;Lee, Jaewon;Kang, Sukjin;Kang, Hunsik
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.4
    • /
    • pp.725-733
    • /
    • 2015
  • In this study, we investigated secondary school science teachers' actual and preferred types of assessment with focus on the purpose and the method of assessment. Participants were 92 secondary school science teachers. We developed a questionnaire asking science teachers about the types of assessment they have actually used and the preferred types of assessment for hypothetical situations that have been generally reported as the prototypical examples of constructivist assessment. The characteristics of the science teachers such as teaching career, experience on in-service training about assessment, and perspective toward constructivist assessment were also examined. The analysis of the actually implemented assessments in their responses revealed that most science teachers tended to aim at traditional purposes such as summative assessment, and that multiple-choice was the most prevailing assessment method followed by experiment, report, and essay. For hypothetical assessment situations, science teachers exhibited their preferences for various types of constructivist assessment methods, whereas their purposes of the assessment still remained to be traditional. The science teachers who have had a relatively constructivist perspective toward assessment showed a statistically significant preference for using formative assessment than their counterparts in the hypothetical assessment situations.

Learning Evaluation System Based on Fuzzy Inference (퍼지 추론기반 학습평가 시스템)

  • Kang, Jeon-Geun
    • Journal of the Korea Computer Industry Society
    • /
    • v.8 no.3
    • /
    • pp.147-154
    • /
    • 2007
  • Many studies have reported that each evaluation had a stronger effect on the development of a student's teaming ability. Nevertheless, in reality schools rely on the results of summative evaluation after the lesson only for the purpose of learning evaluation. Such a method of evaluation is a result-oriented learning evaluation, with no consideration of developing process of loaming ability of each student. Existing learning evaluation has been considered difficult to process learning performance ability in a clearer manner, as it examines teaming performance ability by diagnostic evaluation and learning ability improvement by formative evaluation, separately. Therefore, this paper proposes a learning evaluation method incorporating diagnostic and formative evaluation, using a Fuzzy inference, for a more objective assessment of performance ability. The proposed method assessed teaming ability based on different weight values, in order to reflect the level of diagnostic and formative evaluation.

  • PDF

How to develop tiered tests: A developmental framework using statistical indexes and four tier types in secondary physics

  • Kim, Min-Kee;Jung, Jin-Sun;Pak, Sung-Jae
    • Journal of The Korean Association For Science Education
    • /
    • v.29 no.3
    • /
    • pp.277-290
    • /
    • 2009
  • In the era of the outcome-based education, multiple-choice test has been widely employed owing to its efficiency that enables educators to evaluate a quantity of students with much objectiveness. However, the prevalent test has not been reconsidered enough to overcome its apparent shortcomings: examiners' effort for developing plausible and faultless distracters defending from every falsification, and students' random guessing on key choices. For alleviating such defects, tiered test as an experimental format of multiple-choice tests has been suggested in science education. Since there has not accumulated much study on the implementation of tiered tests, our research aim is set to construct a framework suggesting statistical indexes for rationally discerning tiered units that develop an effective tiered test. Graded both by our tiered-scoring and by the conventional partial-scoring, the preliminary tiered test in secondary physics attests the improvement in its discrimination and difficulty distribution. The findings reveal that the two indexes discern effective tiered items: discrimination increase (Ct-p) and difficulty decrease (Dp-t). Based on the index information, 4 heterogeneous tier types are recommended in the content of secondary physics: directional manipulation, repeated calculation, diverse explanation, and plural variables.

Investigating the reassessment opportunity for prospective teachers within their initial required content course

  • Amanda J. Meiners;Angel Luis Figueroa-Rosado
    • Research in Mathematical Education
    • /
    • v.27 no.2
    • /
    • pp.175-193
    • /
    • 2024
  • In K-12 education, reassessment is a common practice, providing students with opportunities to enhance their understanding through low-stakes assignments. However, reassessment is underutilized in higher education, including during the challenges posed by the COVID-19 pandemic. Our study advocates for expanding the use of reassessment in university settings to promote holistic learning and focus on what shifts of change were made by students in an initial mathematics content course as they sought to gain licensure for teaching in a birth (daycare/pre-K setting) to eighth-grade classrooms. Our study took place during COVID-19 semesters and aimed to examine how using a reassessment approach early on in a gateway course for Prospective Teachers (PTs) affected the pass rate of the course. Results showed significant differences between the PTs who engaged with the test recovery and those who did not. We propose recovery opportunities like ours provide the necessary guidance to support early degree necessary classes that are typically gatekeeping and, as another, likely cause too few students within the courses because they were able to advance into the teacher pipeline and out into the field. Future studies may consider how the reassessment could be done more before the official summative assessment of a unit or chapter to continue the shifts in teaching practices and pedagogy that are constant within the K-12 education systems at the university level.

An Investigation on Science Teachers' Evaluation Practices in the Secondary Schools (중등학교 과학교사들의 학습 평가에 관한 실태조사)

  • Kim, Ho-Jin;Kwack, Dae-Oh;Sung, Min-Wung
    • Journal of The Korean Association For Science Education
    • /
    • v.20 no.1
    • /
    • pp.101-111
    • /
    • 2000
  • The present study was carried out to investigate the actual condition of the evaluation of science learning in the secondary school, and to develop the basic data for the improvement of the science learning assessment. Various questions for three evaluative domains were asked to 51 science teachers with the questionnaire during the in-service training course for certificate on summer in 1998. The cognition of the table of specification appeared high as 98% responses to the questionnaire, but the teachers' ability to distinguish behavioral elements was low as 47% responses. The evaluative rate of three domains for knowledge, skill and attitude appeared as 45%, 35% and 20% evaluation in both diagnostic and formative evaluation and 40%, 40% and 20% evaluation in summative evaluation. The evaluation of process skill appeared a tendency depending on laboratory reports as 61%, and was higher rather than in the formative evaluation or summative evaluation. In the evaluation of attitude domain, about a half of teachers answered that they evaluated the domain with laboratory reports as 43%, and some teachers evaluated the domain with teacher's observation as 33%. Also there were a few teachers who did not evaluate the attitude domain as 8%. The rate for the elements of the process skill appeared 86% responses in the interpretation of data, 31% in the observative ability, 18% in the predictive ability, 14% in the classified ability, 12% in the measuring and data-investigating ability, 4% in the discussion ability, and 2% in the investigating ability. We could find out that many teachers had given higher rate in the evaluation of process skill and attitude rather than before the present study, therefore there was more improvement in the evaluation for process skill and attitude domain after the 6th curriculum.

  • PDF

Analysis of Summative Evaluation Objectives in Middle school Science Examination by Klopfer's Taxonomy of Educational Objectives (중학교 과학과 총괄 지필평가 문항의 목표 분석)

  • Park, HyunJu
    • Journal of Science Education
    • /
    • v.36 no.2
    • /
    • pp.293-302
    • /
    • 2012
  • The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

  • PDF

An assessment of healthy city level by comparing health city index - Comparisons among the selected cities of Korea, Japan and England - (건강도시지표 비교를 통한 건강도시 수준의 평가 -한국, 일본 및 영국의 일부 도시를 중심으로-)

  • Nam Eun-Woo;Park Jae-Sung;Song Yea-Li-A
    • Health Policy and Management
    • /
    • v.16 no.2
    • /
    • pp.1-20
    • /
    • 2006
  • The purpose of this study was to assess healthy city level of the selected cities of Korea, Japan, and England using healthy city index. Based on WHO health city profile, this study proposed 5 index domains comprised with human biology, life style, shelthe & socioeconomic data, environmental & infrastructural data, and public health policy and services. We identified 6 cities (Changwon, Wonju, Seoul, Ichikawa, Fukuroi and Brighton). The human biology level of Korean cities was better than that of Ichikawa, Fukuroi, and Brighton city except Wonju. But the shelter & socioeconomic index level of the foreign cities was better than that of Korean cities. In the environmental & infrastructural idex, even though Changwon city showed the highest level among healthy cities in this study, other Korean cities had lower level compared to the foreign cities. In the public health policy and services index level, except Wonju, Korean cities had lower level than that of all foreign cities. In comparing a summative evaluation index of all proposed index, Ichikawa and Fukuroi had the highest level of city health but Seoul city had the lowest healthy level. Changwon and Wonju had higher level of city health compare to that of Brighton and Seoul. To promote the level of city health, those findings could contribute to healthy city planning process in terms of identifying any weakness and strength of the cities selected in this study.

Summative Usability Assessment of Software for Ventilator Central Monitoring System (인공호흡기 중앙감시시스템 소프트웨어의 사용적합성 총괄평가)

  • Ji-Yong Chung;You Rim Kim;Wonseuk Jang
    • Journal of Biomedical Engineering Research
    • /
    • v.44 no.6
    • /
    • pp.363-376
    • /
    • 2023
  • According to the COVID-19, development of various medical software based on IoT(Internet of Things) was accelerated. Especially, interest in a central software system that can remotely monitor and control ventilators is increasing to solve problems related to the continuous increase in severe COVID-19 patients. Since medical device software is closely related to human life, this study aims to develop central monitoring system that can remotely monitor and control multiple ventilators in compliance with medical device software development standards and to verify performance of system. In addition, to ensure the safety and reliability of this central monitoring system, this study also specifies risk management requirements that can identify hazardous situations and evaluate potential hazards and confirms the implementation of cybersecurity to protect against potential cyber threats, which can have serious consequences for patient safety. As a result, we obtained medical device software manufacturing certificates from MFDS(Ministry of Food and Drug Safety) through technical documents about performance verification, risk management and cybersecurity application.The purpose of this study is to conduct a usability assessment to ensure that ergonomic design has been applied so that the ventilator central monitoring system can improve user satisfaction, efficiency, and safety. The rapid spread of COVID-19, which began in 2019, caused significant damage global medical system. In this situation, the need for a system to monitor multiple patients with ventilators was highlighted as a solution for various problems. Since medical device software is closely related to human life, ensuring their safety and satisfaction is important before their actual deployment in the field. In this study, a total of 21 participants consisting of respiratory staffs conducted usability test according to the use scenarios in the simulated use environment. Nine use scenarios were conducted to derive an average task success rate and opinions on user interface were collected through five-point Likert scale satisfaction evaluation and questionnaire. Participants conducted a total of nine use scenario tasks with an average success rate of 93% and five-point Likert scale satisfaction survey showed a high satisfaction result of 4.7 points on average. Users evaluated that the device would be useful for effectively managing multiple patients with ventilators. However, improvements are required for interfaces associated with task that do not exceed the threshold for task success rate. In addition, even medical devices with sufficient safety and efficiency cannot guarantee absolute safety, so it is suggested to continuously evaluate user feedback even after introducing them to the actual site.

Analysis of Hazard Factors for Domestic General Purpose Ventilator using Usability Assessment (사용적합성 평가를 적용한 국산 범용인공호흡기의 위험요인 분석)

  • Gyeongmin Kwon;Seung hee Kim;You Rim Kim;Won Seuk Jang
    • Journal of Biomedical Engineering Research
    • /
    • v.45 no.1
    • /
    • pp.10-19
    • /
    • 2024
  • The purpose of this study is to conduct a summative evaluation of the usability of a general-purpose ventilator to determine whether it can be used for its intended purpose in the intended environment by the intended user and to find possible errors in use. The importance of ventilators has increased due to the accelerated aging of the population and the impact of the pandemic. In addition, patients who require ventilators are often in critical condition, so even a small error in use can be fatal. Therefore, it is important to ensure that the ventilator has sufficient stability and can be used satisfactorily without inconvenience to the user. In this study, we conducted a usability test with 17 respiratory nurses with more than 3 years of experience using the ventilator. We analyzed the task success rate, satisfaction, and opinions of the intended users while going through a total of 17 scenarios. Satisfaction was captured through an ASQ questionnaire and subjective opinions were captured through a detailed opinion questionnaire. The results showed a high level of satisfaction with an average score of 6.3 for the use scenarios. Evaluators expressed satisfaction with the overall visibility and versatility of the features, but noted that improvements were needed for calibration tasks with low task success rates. As the calibration method is different from other equipment, it was suggested that specific explanations of the calibration method and the picture that appears when calibrating are needed, and that if relevant training is provided, the equipment can be used without problems. If the usability evaluation is not limited to securing efficiency and satisfaction from the intended users, but also continuously receives feedback from users to prepare for use in emergency environments such as pandemic situations, it will be very helpful to seize opportunities such as emergency authorization in future situations, and ultimately contribute to patient safety by reducing use errors.

A Comparative Study of Korean Home Economic Curriculum and American Practical Problem Focused Family & Consumer Sciences Curricula (우리나라 가정과 교육과정과 미국의 실천적 문제 중심 교육과정과의 비교고찰)

  • Kim, Hyun-Sook;Yoo, Tae-Myung
    • Journal of Korean Home Economics Education Association
    • /
    • v.19 no.4
    • /
    • pp.91-117
    • /
    • 2007
  • This study was to compare the contents and practical problems addressed, the process of teaching-learning method, and evaluation method of Korean Home Economics curriculum and of the Oregon and Ohio's Practical Problem Focused Family & Consumer Sciences Curricula. The results are as follows. First, contents of Korean curriculum are organized by major sub-concepts of Home Economics academic discipline whereas curricular of both Oregon and Ohio states are organized by practical problems. Oregon uses the practical problems which integrate multi-subjects and Ohio uses ones which are good for the contents of the module by integrating concerns or interests which are lower or detailed level (related interests). Since it differentiates interest and module and used them based on the basic concept of Family and Consumer Science, Ohio's approach could be easier for Korean teachers and students to adopt. Second, the teaching-learning process in Korean home economics classroom is mostly teacher-centered which hinders students to develop higher order thinking skills. It is recommended to use student-centered learning activities. State of Oregon and Ohio's teaching-learning process brings up the ability of problem-solving by letting students clearly analyze practical problems proposed, solve problems by themselves through group discussions and various activities, and apply what they learn to other problems. Third, Korean evaluation system is heavily rely on summative evaluation such as written tests. It is highly recommended to facilitate various performance assessment tools. Since state of Oregon and Ohio both use practical problems, they evaluate students mainly based on their activity rather than written tests. The tools for evaluation include project documents, reports of learning activity, self-evaluation, evaluation of discussion activity, peer evaluation in a group for each students for their performance, assessment about module, and written tests as well.

  • PDF