• Communications of Mathematical Education
• /
• v.23 no.3
• /
• pp.923-951
• /
• 2009

In this paper, we have analyzed the term examinations on quadratic equations and functions in middle schools based on the object of evaluations given by the ministry of education, science and technology of Korea.

• Journal of Science Education
• /
• v.36 no.2
• /
• pp.293-302
• /
• 2012

The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.7
• /
• pp.275-283
• /
• 2017

The purpose of this study is to investigate the evaluation scores among various evaluators such as tutor, peer, and self evaluation, the lenience and central tendency among these various evaluators, and the correlation between evaluation scores among the various evaluators and the paper test score in the Problem-Based Learning (PBL). For the research, tutor, peer, and self evaluations were carried out with PBL effectiveness evaluation tool for the 105 nursing students taking classes using PBL, and paper test was conducted after the PBL class ended. The collected data were analyzed by SPSS WIN (V. 12.0). The study results showed that peer and self evaluation scores were higher than tutor evaluation score. Also lenience and central tendency were higher and stronger in peer and self evaluation than in tutor evaluation. Paper test score had a significant correlation with tutor evaluation score, but not with peer or self evaluation scores.

• School Mathematics
• /
• v.19 no.1
• /
• pp.43-58
• /
• 2017

According to the degree of teacher's understanding for the curriculum, There are a lot of differences in teaching-learning methods and assessment items are one of the representative products reflecting these differences. Therefore we need to investigate how the understanding degree of the teacher for curriculum is reflected in the paper-based assessment items through analyzing them. In this study, we analyzed midterm and final 219 exam papers of 'Calculus I' which was based on the 2009 revised mathematics curriculum and focused on items of 'the Limit of Sequences' which content area is among total 4,632 questions. We investigated how the changed curriculum is reflected in the high school evaluation. Based on the results of the analysis, we confirmed the problems derived from the paper-based assessment. Through this, we sought to draw implications for the educational policy that should be accompanied necessarily in order to stabilize the new curriculum after the revision of the curriculum.

• Journal of The Korean Association For Science Education
• /
• v.37 no.2
• /
• pp.225-237
• /
• 2017

In this study, we investigated the characteristics of the individual processes of pre-service chemistry teachers in making written test items. For this, we analyzed the think-aloud processes of eight pre-service chemistry teachers while making six written test items about gas laws and their in-depth interview scripts. The characteristics of the processes were found to be divided into six categories; the lack of systemicity in planning stage for making written test items, the lack of awareness and consideration for the interrelationship between instruction and assessment, the diverse criteria in determining test item types, the difficulties in judging behavioral domains and difficulties of items in the table of specification, the limitation in using teacher's guides and misunderstanding of teacher's guides, and the limitation in point and/or content of review and differences depending on the time of review. These can provide some significant guidelines and implications in finding ways to improve pre-service chemistry teachers' ability to make written test items.

• Communications of Mathematical Education
• /
• v.18 no.2 s.19
• /
• pp.143-154
• /
• 2004

학교에서 실시되는 평가의 주체는 교사이므로, 교사는 '좋은 평가 도구'를 개발 ${\cdot}$ 제작 할 수 있어야 한다. 좋은 평가 도구를 제작하기 위해서는 이에 대한 직접적인 훈련이 필수적인 동시에 교사 교육의 첫 단계부터 좋은 평가 도구로 평가를 받는 간접 경험도 중요하다. 이 논문에서는 문항반응이론을 적용하여 수학교사 양성기관에서 사용되는 지필고사 문항에 대하여 신뢰도, 타당도, 난이도 및 변별도를 측정하였다. 이 결과는 평가 문항을 개발할 때에 기초자료로 사용될 수 있다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.10a
• /
• pp.595-598
• /
• 2009

최근 영재 및 영재교육에 관련된 연구가 다방면에서 진행되고 있으며, 초기에 수학 및 과학 분야 위주로 이루어졌던 영재교육은 정보, 발명, 인문, 예술 등의 기타 분야로 점차 확대되어 가고 있다. 사회적으로는 고도화된 정보화 사회로의 진행과 더불어 정보과학에서도 영재교육데 대한 관심과 중요성이 커지고 있다. 그러나 정보과학의 학문적 역사가 짧고 그 범위의 설정이 어려운 만큼 정보과학 분야의 영재교육에 있어서도 대상자의 선발과 교육이 어려운 것이 사실이다. 특히 영재교육 대상자의 선정과 교육에 필수적인 평가 방식에 대한 학문적 연구가 부족하여 교육 방식의 보완과 창의적인 대상자 선발에 있어 개선에 대한 목소리가 높다. 이에 본 연구에서는 여러 형태의 평가 방식 중 관찰평가가 평가도구로서 어떻게 작용하는지 다면 평가의 측면에서 지필평가와 보완적 작용을 하는지에 대해 연구하였다. 이를 위해 2년간의 학습자들의 지필평가 성적과 관찰평가 중 리커트 척도 방식의 체크리스트와 서술형 관찰 기록지 사이의 상관관계를 통계적으로 분석 하였다. 또한 항목간의 상관관계를 알아보기 위해 체크리스트와 서술형 관찰기록지의 하위 항목간의 상관관계를 분석하였다. 연구 결과 체크리스트의 하위항목 분석을 통해서는 태도와 문제해결 능력 간의 상관관계, 수학적인지영역과 문제해결 능력 간의 유의미한 상관 관계를 알 수 있었으며, 서술형 관찰 기록지 분석을 통해서는 투입 프로그램 적응 능력이라 할 수 있는 과정적 영역은 정의적 영역과 인지적 영역의 상관 관계가 중요함을 알 수 있었다. 또한 평가 방식간의 상관 관계는 지필 평가와 관찰 평가의 유의미한 연관성이 없다는 것이 밝혀졌다. 즉, 정보과학 분야 영재교육 학습자의 잠재 능력이나 사회성, 창의성, 문제해결력 등을 평가하기 위해서는 지필평가와 더불어 관찰평가가 반드시 필요하며 다면평가의 측면에서 상호 보완적인 역할을 한다는 것이다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2011.06b
• /
• pp.262-265
• /
• 2011

많은 학습 시스템에서 학습자의 수준에 맞는 맞춤학습을 위해서 학습자의 정확한 능력을 측정하는 평가 방법이 필요하다. 기존의 지필고사는 이를 위해서 학습자의 능력과 관련된 많은 수의 문항을 똑같은 시간과 순서대로 풀게 되므로 평가의 효율성 면에서 문제를 가지고 있다. 따라서 이러한 지필고사방식의 문제점을 해결하기 위해 문항정보이론과 컴퓨터의 처리성능을 결합시킨 컴퓨터화된 적응적 검사(CAT)에 대한 연구가 활발히 진행되고 있다. CAT는 지필고사의 문제점을 상당부분 해결했으나 문항간 연관성에 대해서는 독립을 가정하여 그렇지 않은 경우에는 비효율성을 가져올 수 있다. 본 논문에서는 문항반응이론 방식의 CAT가 가진 문제점을 해결하면서 성능이 개선된 베이지안 네트워크를 도입한 CAT를 제안한다. 이는 베이지안 네트워크에 평가문항을 세부분야별로 대입하여 한 문항에 대한 응답으로 그와 연관된 분야의 학습자 능력을 추론한다. 또한 실험을 통해 기존의 기법을 사용했을 때에 비해 학습자의 실제 능력치에 수렴하는 속도가 증가함을 보인다.

• Journal of Educational Research in Mathematics
• /
• v.24 no.4
• /
• pp.573-594
• /
• 2014

Capacity of making assessment items among teacher's assessment competency is essential element in validity and reliability of assessment. Errors in test items on the formal and content aspects can be a big stumbling block to derive a correct evaluation result. Through this assessment, the positive feedback can not be derived. In this study, By analyzing midterm and final 60 exam papers for geometry and vector in 45 high Schools of Seoul GyeonggiIncheon area, We argue error items and improvements on the formal and content aspect the paper-based assessment of mathematics. Through this, Our intention is to improve the skills of teachers for making assessment items.

• Journal of The Korean Association For Science Education
• /
• v.36 no.5
• /
• pp.769-781
• /
• 2016

This study investigated the interactions among the PCK components of pre-service secondary chemistry teachers considered in the processes of making written test items individually and in small groups. The processes of making written test items individually for 8 pre-service teachers was studied through the think-aloud method. The analysis of the results revealed that the 'assessment in science education' of the five PCK components was most frequently used in making test items. 'Curriculum for science education,' 'subject matter knowledge,' and 'students' were also frequently used although fewer than the previous component. However, 'instructional strategies and instruction for science education' was hardly used. The integrations between two or three components with various types were frequently found. However, integrations among four to five components were not found. The processes of making written test items in two small groups consisting of four pre-service teachers were observed. The analysis of the results revealed that the PCK components used in small groups were similar to those in the individual processes. However, 'curriculum for science education' was less frequently used, and the numbers of subcategories used at a relatively high frequency increased from other four components in small groups. In the aspects of integration, the proportion of the integrations between two components decreased and that for three components increased compared with those in the individual processes. The integrations among four or five components were also newly found. However, the integrations of 'curriculum for science education' with the other components were less frequently found. The integrations of 'instructional strategies and instruction for science education' with other components were still hardly found.