• Journal of The Korean Association For Science Education
• /
• v.43 no.1
• /
• pp.17-28
• /
• 2023

In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of the Korean School Mathematics Society
• /
• v.10 no.4
• /
• pp.535-555
• /
• 2007

The framework for mathematics assessments traditionally has been organized around two dimensions, a content dimension specifying the subject matter to be assessed within mathematics, and a cognitive dimension specifying the domains or thinking processes to be assessed. The cognitive dimensions describe the sets of behaviors expected of students as they engage with the mathematics content. The purpose of this paper is an attempt to make diversify and concrete the sets of behaviors by reviewing the current strands suggested by CAST(College Scholastic Ability Test), assessment framework developed by KEDI, and NAEA(National Assessment of Educational Achievement), and as famous foreign tests PISA, TIMSS, NAEP and NCTM.

• Journal of Science Education
• /
• v.47 no.3
• /
• pp.251-262
• /
• 2023

In this study, we examine other factors that may contribute to the decline in students' academic performance and educational attainment. Many media reports, as well as previous studies, have suggested that virtual learning is the main reason for the decline in students' academic performance. However, the 2020 National Student Achievement Survey, which was conducted in conjunction with the COVID-19 Distance Learning Environment Student Survey, showed that students were highly satisfied with distance learning (70-80%), and the analysis of the National Assessment of Educational Achievement showed that students' academic performance had already been declining year by year since 2017, with a general downward curve. For further confirmation, we analyzed the performance of high school students on mock exams and found that their performance was not normally distributed, but rather a right-skewed U-shaped distribution with a shrinking number of medians and severe polarization. We found that this phenomenon is not simply because of the mode or quality of the virtual classroom, but to a variety of factors, including environmental influences such as care and management at home, changes in investment in private education, increased time spent on online devices while taking virtual classes at the bottom, and increased time spent watching online content, games, and videos that are not related to learning.

• Journal of The Korean Association For Science Education
• /
• v.17 no.2
• /
• pp.139-148
• /
• 1997

This study investigated the influences of the cooperative learning strategies upon students' achievement and their perceptions of learning environments in a middle school physical science course. Prior to instruction, the Group Assessment of Logical Thinking was administered, and its score was used as a blocking variable. Mid-term examination score was used as a covariate. For the treatment group with heterogeneous grouping, cooperative learning instruction (the Learning Together model) was used, which emphasized group reward, individual accountability, and role division. For the control group, traditional instruction was used. After instruction, an achievement test consisting of three subtests (knowledge, understanding, and application), and the perception questionnaire of classroom and laboratory environments, were administered. ANCOVA results revealed that there was a significant interaction between instruction and the level of logical reasoning ability although there were no significant differences in all three subtest scores of the achievement test. For the concrete operational reasoners, the treatment group performed better in the subtests of understanding and application than the control group. For students at the formal and transition levels, however, the treatment group scored lower than the control group. Significant interactions were also found in the perceptions of classroom environment and laboratory environment. For the concrete operational reasoners, the treatment group showed more positive perception than the control group. For the students at the formal and transition levels, the control group had positive perception than the treatment group. Educational implications are discussed.

• Korea Real Estate Review
• /
• v.28 no.3
• /
• pp.65-77
• /
• 2018

The purpose of this study is to analyze the effect of the educational environment on the prices of studio apartments, known as officetels, in Korea. Since the revision of relevant laws in 2010, they have served as substitutes for residential purposes in areas suffering from housing shortage, especially where the educational environment is a significant factor. To assess the relation between the educational environment and rental rates, the hedonic price model and artificial neural networks were implemented. The national assessment of the academic performance of middle and high schools that were closest to each officetel, and the ratio of students going to special-purpose schools and private high schools were considered as independent variables. Research findings indicated that the positive effect of the dependent variable increased as the value of educational environment-related variables increased. This result could be utilized as a functional index for housing providers after considering educational environments.

• Journal of Elementary Mathematics Education in Korea
• /
• v.5 no.1
• /
• pp.19-36
• /
• 2001

The aim of the study is to explore some problems that we have to solve to execute assessments effectively and in agreement with the objectives of them. We analysed the practices of some assessments Including our national assessment of educational achievement and the third international mathematics and science study with focussing on the frames of assessments, the analyses of results, and the items presented in the assessments. The results of the study are the following. Firstly, we need to make the frame of assessment to agree with the objectives of assessment and to reflect the characteristics of the item related to a few areas. Secondly, we need to analyse the results of assessment with reflecting the frames of assessment. Thirdly, we need to discuss more concretely on the level and presentation of items including the order of conditions to need to solve the items. And lastly, we need to minimize the difference caused by the variations of translation in the international assessments.

• Journal of The Korean Association For Science Education
• /
• v.19 no.2
• /
• pp.185-193
• /
• 1999

The long term trend of studensts' science achievement is a very important factor to check the effectiveness of science educational policy. However, up to date no such effort to understand the trend of Korean students' science achievement has been put into action. Recently, the Science Education Center in Korea National University of Education has been attempted to collect nation wide data for students' science achievement. The first part of the effort was to develop item pools. This study was the second part to collect nation wide data and to check any change during the two year time interval. In this study, the item pools developed by Kwon et. al.(1998) were used with some modification. The data were collected two times; February 1997 and March 1999. The subjects collected nationally were 8,766 students in 1997 and were 4,398 in 1999. The subjects were collected randomly but stratified by region and sex. As the results, the trends of achievement change during the two years were different from elementary to high school. The achievement scores were decreased in elementary schools and increased in high school. In case of middle schools, the change was not significant. However, even in elementary schools the knowledge on theory was increased significantly while knowledge on facts and principles were decreased. In contrast, the knowledge on fact showed the most increase in high schools. In this study, the data were analysed in light of region, sex, behavioral objective levels(ability) and context of test items. The science achievement monitoring system developed by the Science Education Center in Korea National University of Education can be an effective tool for monitoring students' achievement on the national level.

• Journal of Korean Elementary Science Education
• /
• v.42 no.4
• /
• pp.523-537
• /
• 2023

This study encompassed the responses of 284 elementary school teachers, focusing on their teaching experiences, readiness, and needs for science education concerning the risk posed by science and technology. The key findings are summarized as follows. First, a significant portion of teachers lacked prior experience in addressing risks associated with science and technology within their science education practices. Second, a greater number of teachers were aware of the inclusion of risk-related content in the 2022 revised science curriculum's achievement standards than those who were not. Third, in terms of teachers' understanding of risk perception, risk assessment, and risk management, they demonstrated a relatively high level of understanding of risk perception but a lower level of understanding of risk assessment. Fourth, most teachers had not undergone any formal education or training related to risk. Fifth, among the 10 objectives of risk education, teachers displayed the highest competence in teaching "information use" and "action skills," while their lowest competence was observed in "interpreting probabilities" and "evaluating risk assessment." Sixth, a majority of teachers believe that it is important to teach about the risks posed by science and technology in school science classes, with "action skills," "information use," and "decision-making skills" being considered the most important and "action skills," "information use," and "influence of mass media" being regarded as the most urgent. However, teachers anticipated difficulties in addressing risk in school science classes, including a lack of relevant educational materials, a lack of understanding of teaching theories related to risk education, and the relationship between science curriculum content and achievement standards. Seventh, as a result of calculating the educational needs for each of the 10 goals of risk education, "influence of risk perception," "decision-making skills," "action skills," and "evaluate risk assessment" were the priority needs of elementary school teachers.

• Korean Medical Education Review
• /
• v.20 no.3
• /
• pp.135-140
• /
• 2018

In clinical clerkships, residents function as trainees, workers, and teachers for other medical students. Although residents care for patients in harsh environments and encounter precarious patient-safety situations, they are working towards becoming competent specialists. Residency education programs are very important in cultivating specialists able to adapt to the rapidly-changing medical environment, and are also necessary to improve the quality of specialist training. Competent specialists not only need clinical competency, but also a wide range of abilities including professionalism, leadership, effective communication, cooperation, and attention to continuous professional development/continuing medical education activities. Each Korean association of specialties has its own educational goals and standardized education programs to help residents learn specific techniques and competencies related to medical care for patients, though the training environment of each residency is different within each trainee hospital. Although it is also important to evaluate residency education programs, currently there is only an examination of knowledge and assessment of skills based on mini-clinical evaluation exercises or direct observation of procedural skills. In order to develop an objective and estimable evaluation tool that can assess the overall achievement level within each training course, it is necessary to evaluate the knowledge, skills, and attitudes of residents. Residency education programs need further attention and reform.