• Research in Mathematical Education
• /
• v.22 no.3
• /
• pp.153-174
• /
• 2019

Measuring alignment of various educational components is an important issue in educational research because with aligned educational system, we can have clear expectations about what to teach and assess. In this study, we examined the alignment between mathematics curriculum standards and college entrance examinations from Korea and China. The results indicate that curriculum standards and high stakes assessments from both countries are not well aligned to each other. Their Surveys of Enacted Curriculum (SEC) indices were lower than what previous studies have found and the critical values (Fulmer, 2011; Liu & Fulmer, 2008; Liu et al., 2009). There are several topics that are not assessed in both countries' national assessments. Also, discrepancies between the most frequently covered topics in the curriculum standards and the most frequently assessed mathematical topics in the national assessments caused topic level misalignment. We also found misalignment in cognitive level. Both national assessments included more perform procedures and demonstrate understanding items than their respective curriculum standards. Thus, previous findings about the inclusion of more items with higher cognitive demand in assessments is only partially true for either country. With these results, it is difficult to say that whether mathematical topics in the curriculum standards appropriately represent and support students to do well on the CSAT and the NCEE or that the mathematical items in the CSAT and the NCEE validly assess students' level of mathematical understanding.

• East Asian mathematical journal
• /
• v.25 no.3
• /
• pp.279-297
• /
• 2009

This paper discusses the key differences and common themes among three major assessments of pre-college mathematics learning: Program for International Student Assessment (PISA), Third International Mathematics and Science Study Repeat (TIMSS-R), and National Assessment of Educational Progress (NAEP).

• Journal of Educational Research in Mathematics
• /
• v.23 no.4
• /
• pp.533-551
• /
• 2013

The purpose of this study is to investigate how middle school mathematics teachers understand the definition and the purpose of constructed-response assessments as well as what they expect from the assessments. By examining the responses of 189 middle school mathematics teachers to the survey, we found that there is discrepancy between their perceptions and reality of the constructed-response assessments in practice. In other words, teachers' practice is not well aligned with their perceptions and expectations due to the restraint of school system and environment. The findings give us some meaningful implication for the improvement of effective constructed-response assessments and professional development.

• School Mathematics
• /
• v.15 no.2
• /
• pp.263-288
• /
• 2013

This study was conducted to provide practical ways to apply interview assessments in classrooms. Interview assessments have been asserted to serve as one of the alternatives to the traditional paper-and-pencil tests. In order to propose ways for teachers to actively use interview assessments for mathematics assessments, relevant instruments were developed by analyzing a number of related theories. These instruments were developed in two forms: interview assessments focused on identifying student characteristics and those focused on identifying thought processes. The interview assessments were applied in classroom settings and the results of this application were analyzed. The findings from this study are expected to suggest beneficial implications for teachers who are interested in practicing interview assessments in classrooms.

• Journal of Educational Research in Mathematics
• /
• v.25 no.3
• /
• pp.281-302
• /
• 2015

In the current study, answer sheets from 8007 students in 236 Korean schools were selected and analyzed to examine errors that emerge in the process of solving descriptive questions of the National Educational Achievement Assessment in mathematics. Questions used in the analysis were response assessment covering middle school mathematics topics: "mathematical symbols and equations" and "functions." The behavioral domain of the questions was that of "problem solving and computation," which requires establishing an equation for a word problem and allows the calculation of an answer that meets a certain condition. The analysis results revealed various errors in each stage of each question, from understanding to solving; the study attempts to conjecture causes for these errors and draw pedagogical implications.

• Journal of The Korean Association For Science Education
• /
• v.43 no.3
• /
• pp.191-207
• /
• 2023

In this study, we comprehensively investigated the cases of science teachers who implemented NOS assessments in Science Inquiry Experiment. Two science teachers working at high schools located in Seoul who taught and assessed NOS in Science Inquiry Experiment according to the 2015 revised curriculum participated in the study. We collected lesson and assessment materials and observed NOS lessons and assessments. We also conducted interviews. Based on the collected data, we analyzed the processes of the teachers' NOS assessments. The analyses of the results revealed that the teachers constructed the assessments by themselves due to a lack of NOS assessment experience and related materials. They had difficulties in selecting an appropriate assessment method and constructing assessment questions and criteria. Both teachers found it difficult to assess an understanding of NOS because it concerns the subjective views of individual students. Therefore, they had difficulties in setting detailed assessment criteria, which also led to difficulties in the overall assessment process. There was a difference in the reflective level of the assessments between the two teachers. In the reflective activities of low levels, the assessments were not properly enacted because it was difficult to infer students' understanding. Orientation toward teaching NOS influenced the perceptions of NOS assessment and overall lessons, resulting in a difference in NOS assessments. Finally, the absolute evaluation of Science Inquiry Experiment also affected teachers' NOS assessments. Based on the above results, implications for effective NOS assessments in schools are discussed.

• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• Journal of Elementary Mathematics Education in Korea
• /
• v.5 no.1
• /
• pp.19-36
• /
• 2001

The aim of the study is to explore some problems that we have to solve to execute assessments effectively and in agreement with the objectives of them. We analysed the practices of some assessments Including our national assessment of educational achievement and the third international mathematics and science study with focussing on the frames of assessments, the analyses of results, and the items presented in the assessments. The results of the study are the following. Firstly, we need to make the frame of assessment to agree with the objectives of assessment and to reflect the characteristics of the item related to a few areas. Secondly, we need to analyse the results of assessment with reflecting the frames of assessment. Thirdly, we need to discuss more concretely on the level and presentation of items including the order of conditions to need to solve the items. And lastly, we need to minimize the difference caused by the variations of translation in the international assessments.

• The Journal of Korean Academy of Sensory Integration
• /
• v.2 no.1
• /
• pp.43-52
• /
• 2004

Objective : This study is to know about the play awareness of occupational therapists with using the sensory integration approach, and is to suggest educational strategies of play as occupation and research. Methods : 124 occupational therapists completed the questionnaires including the general use of play in occupational practice and the use of play assessments with preschoolers, and factors influence on the use of play in occupational therapy for children. Results : Respondents used the play as therapy modality and performed much with based on sensory integration and development approach in individual occupational therapy room with variable play tools. It was restricted to use as objective assessment tools and methods, and had important factors that influence on the use of play in occupational therapy for children; role of occupational therapy in work setting, personal frame of reference and availability of play assessments. Conclusion : The results suggest a need for increasing the emphasis on play in entry-level curricula and continuing education, improving clinician access to valid and reliable play assessments, and completing studies designed to examine the use and efficacy of play in sensory integration therapy intervention.

• Journal of Engineering Education Research
• /
• v.23 no.6
• /
• pp.60-67
• /
• 2020

This study was conducted to understand the experiences of engineering college professors teaching classes online due to COVID-19. Instructional strategies were proposed based on these results. This study qualitatively analyzed interviews of four engineering college professors who switched from teaching classes offline to teaching them online in the first semester of 2020. The results showed that the professors had difficulties in creating video content, interacting with students, and conducting online assessments. The results also showed that the professors had difficulties in switching to online teaching. This study was significant in that it produced empirical data about online teaching based on the experiences of engineering college professors teaching classes online.