• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.76-92
• /
• 2002

OECD/PISA(Programme for International Student Assessment) is significant in that it is the first international comparative study assessing 15-year-old students' scientific literacy. Based on Korean students' results of percent correct in 35 science items, several characteristics such as followings were revealed. First, from the perspectives of science application area, Korean students showed the highest achievement in the area of 'science in technology' followed by in the areas of 'science in life and health' and 'science in earth and environment'. Male students achieved significantly better than female counterparts in all three areas. Second, the achievement in items of science knowledge was significantly higher than in items of scientific processes. Whereas the achievement difference between science knowledge- and scientific process items was larger for male students. Third, from the perspectives of application contexts, Korean students showed the highest achievement in the historical context and the lowest achievement in the personal context. Fourth, from the perspectives of item format, Korean students performed significantly better in open-constructed items rather than in multiple-choice items. Fifth, Korean students showed low performance in items of biotechnology and environment-related issue, which was more prominent for female students. Sixth, whereas male students performed significantly better than female students in most aspects, it is noteworthy that there was no significant gender differences in items of scientific processes and females performed significantly better than male students in open-constructed items which require long sentence.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.10
• /
• pp.255-265
• /
• 2022

We compared and analyzed the factors affecting the lecture evaluation of IT subjects, which are mandatory for all students of H University. The purpose of this study is to determine whether lecture satisfaction has a significant correlation with academic achievement, attendance rate, and categories of courses. In this study, we check whether the lecture satisfaction of IT liberal arts subjects that require a lot of computer-based practice differs from that of other liberal arts subjects. We used the 2,149 evaluation data of 12 lectures submitted by 2,322 students in the first and second semesters of year 2019 at University H. As for the lecture evaluation results, in addition to the evaluation scores of the multiple choice questions, the subjective questions were also quantified by classifying the statements submitted by the students into positive and negative types to make the results of the lecture evaluation objective. Our research results show that student group who have the higher attendance rates and academic achievements have higher level of lecture satisfaction and they also use more positive words than negative words in subjective evaluation questions. Students with the lower score use the more negative words, but the ratio between positive and negative words does not differ between groups. Higher attendance rates groups in the basic programming courses and software applications courses have higher lecture satisfaction ratio. But in the intermediate programming courses, the higher attendances rate and the lecture satisfaction do not have any significant relationship. Also students in the intermediate programming courses use more negative words than those in the basic programming courses.

• Journal of the Korean earth science society
• /
• v.25 no.8
• /
• pp.647-655
• /
• 2004

PISA (Program for International Student Assessment) 2003, the second cycle of PISA, collected data with respect to students' cross-disciplinary problem solving capabilities. Problem solving is defined as the ability to use cognitive processes to solve real cross-disciplinary problems. For the purpose of PISA 2003 assessment, three problem types were chosen: Decision Making, System Analysis and Design, and Trouble Shooting. For this paper a preliminary analysis on Korean students' responses to the PISA 2003 problem-solving items was conducted. The quantitative analysis mainly focused on the difficulties of the PISA 2003 items, while the quantitative analysis dealt with students' responses to open-ended items, which helped understand Korean students' cognitive style and reasoning processes. According to the item analysis result, Korean students had difficulty in representing their answers with pictures or graphs, and interpreting long and complex text. They also showed low achievement with relatively unfamiliar topics or tasks. The paper concluded with several suggestions on improve the quality of science education.

• Journal of The Korean Association For Science Education
• /
• v.28 no.1
• /
• pp.32-46
• /
• 2008

The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

• Journal of Science Education
• /
• v.46 no.1
• /
• pp.1-16
• /
• 2022

The purpose of this study is to explore learning progressions for global warming at middle school level. For this purpose, we conducted a construct modeling approach that specifies constructs, item designs, outcome spaces, and measurement model steps from April to October, 2021. In order to develop student assessment items, we analyzed the 2015 revised curriculum and textbooks of middle school and categorized a concept hierarchy for each construct to create a construct map. The assessment items were developed into multiple-choice, short answer, and essay questions according to the selected constructs to strengthen the linkage between the constructs and the items. Based on the three-step grading criteria for each item, an online assessment of 21 minor items developed for middle school students show that many students met 'high' level, but none met 'low' level. In this manner, the initial set lower anchor was reset to level 0, the original set upper anchor was lowered from level 4 to level 3, and the hypothetical learning progression for global warming was presented in the following order: phenomenal, conceptual, and mechanical understandings. The results of the research have raised implications for reorganizing the next science curriculum and improving the assessment system.

• Journal of Elementary Mathematics Education in Korea
• /
• v.18 no.1
• /
• pp.123-148
• /
• 2014

The purpose of this study is to figure out the perceptional characteristics of mathematically gifted elementary students by comparing the mathematical reasoning ability and errors between mathematically gifted elementary students and non-gifted students. This research has been targeted at 63 gifted students from 5 elementary schools and 63 non-gifted students from 4 elementary schools. The result of this research is as follows. First, mathematically gifted elementary students have higher inductive reasoning ability compared to non-gifted students. Mathematically gifted elementary students collected proper, accurate, systematic data. Second, mathematically gifted elementary students have higher inductive analogical ability compared to non-gifted students. Mathematically gifted elementary students figure out structural similarity and background better than non-gifted students. Third, mathematically gifted elementary students have higher deductive reasoning ability compared to non-gifted students. Zero error ratio was significantly low for both mathematically gifted elementary students and non-gifted students in deductive reasoning, however, mathematically gifted elementary students presented more general and appropriate data compared to non-gifted students and less reasoning step was achieved. Also, thinking process was well delivered compared to non-gifted students. Fourth, mathematically gifted elementary students committed fewer errors in comparison with non-gifted students. Both mathematically gifted elementary students and non-gifted students made the most mistakes in solving process, however, the number of the errors was less in mathematically gifted elementary students.

• School Mathematics
• /
• v.1 no.1
• /
• pp.187-216
• /
• 1999

The purpose of this study is to develop mathematics performance assessment items for the 8th graders and to analyze their performance ability. First, five-themes were selected : 'Calculator', 'Cut and Paste', 'Rule finding', 'Place Assignment', 'My thinking'. Then, the assistance of Mathematics education specialists and Teachers, 10 P. A. items consisting of two subtasks and their evaluation rubric were developed. Then, items were revised by the results of pilot test. And, final version of items were administrated to the 8th graders of three regions(Seoul, Chongiu, Chungp$\acute{y}$ong). Through analyzing the performance ability of the subjects assessment items, the following conclusion were obtained: They were very insufficient in the ability to find some patterns in the given problem situation and to describe logically the patterns in terms of mathematical terminology. It is believed because they were familiar with the objective test to take one or short answer.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.40-53
• /
• 2002

This study was based on the analysis of earth and environmental science items in PISA 2000 data. The purpose of this study was to identify i) gender differences in scientific literacy, ii) item characteristics that favored either female or male, and iii) misconceptions that 15-years-old Korean students have in the field of earth and environmental science. The results revealed significant gender differences. Overall, male students demonstrated higher level of achievement than female students. On the other hand, amongst high ability students, female students outperformed male students in open-constructed items. Female students tended to score higher on items that required long answers or items related to scientific processes, whereas male students outperformed female students in science knowledge or items that required data interpretation. The study also revealed that a majority of Korean students had misconceptions in fundamental earth and environmental science knowledge, such as the direction of earth's axis and equator, and the causes of Greenhouse Effect.

• Journal of the Korea Convergence Society
• /
• v.12 no.10
• /
• pp.343-352
• /
• 2021

A convergence study was conducted to develop a smartphone application for self-practice of core nursing skills and evaluate its usefulness for undergraduate nursing students. Mobile Application Rating Scale and seven essay questionnaire were used to for usability evaluation among 22 undergraduate nursing students. The score of the information domain was the highest with 4.19(SD 0.79). The subjective quality domain showed the lowest score of 3.08(SD 0.87). Participants' performance confidence score was 8.23(SD 1.60), and learning satisfaction score was 7.89(SD 0.87). Participants reported that the convenience and repetitive self-learning were the strengths of the app. In addition, design and technical supplementation, and lecturer-feedback would improve effectiveness of the current educational app. Findings of this convergent study would be helpful to promote the application of mobile apps for effective self-learning of core nursing skills in undergraduate nursing education. Future resesarch is needed to examine effectiveness study of mobile app on the performance of core nursing skills.

• Journal of The Korean Association For Science Education
• /
• v.39 no.1
• /
• pp.143-160
• /
• 2019

This study investigated 15 science teachers' perception and practice on free semester and science assessment. We analyzed frequencies of teacher choice for closed questions and used constant comparative method for teacher description and individual interview. Most teachers determined a low ranking for changes in assessment methods and mentioned a lack of objectivity on free semester assessment, unsystematic free semester assessment, and more importance on student activity and interest in science instruction. Most teachers understood process-based assessment as a direction of free semester assessment and teachers mentioned positive aspects for students or teacher difficulties dependent on their perception on process-based assessment. Half of the teachers failed to implement student self-assessment and student peer-assessment due to subjectivity and complexity. Some teachers did not provide feedbacks to students due to a lack of time and did not use certain assessment methods due to a lack of knowledge of the assessment. Teachers who did not have an experience of discussions in a teacher learning community mentioned reasons regarding a small number of the same grade teachers and inactive attitude of colleagues. Teachers who did not participate in professional development programs mentioned a lack of teacher understanding of free semester, participation of the teacher in charge, and teacher choice of participation as reasons.