• 아동학회지
• /
• 제23권4호
• /
• pp.199-213
• /
• 2002

This preliminary study aimed to develop 3 assessment scales for self-evaluation by day care directors and teachers. The development of major areas of evaluation and items as well as evaluation criteria for each item was based on the analysis of related research and major evaluation instruments. A panel of experts in early childhood education examined the contents. The 3 preliminary scales were administered in 87 day care centers; data were analyzed by item response distribution, item discrimination, and reliability of the scales. Items indicating low item discrimination were deleted and minor revisions were made to improve psychometric characteristics of each scale. The final version of the 3 scales is valid for use as self-evaluation instruments by day care directors and teachers.

• East Asian mathematical journal
• /
• 제32권2호
• /
• pp.217-232
• /
• 2016

The purpose of this study is to investigate the assessment expertise of Mathematics' teachers, focusing on the competence in designing assessment item development. In this present research, I analysed how the teachers' competence appears in designing assessment items development when they generated problems the given problem into a new one. To examine this assumption, the following research questions were posed and investigated in the present study : How do Pre-service and In-service Teachers in primary schools develop the assessment item when generating problems the given problems into new problems? The result from the case study of metamorphosing the given problem into a new problem teachers used similar patterns switching numbers or changing units in order to develop new problems. Also, teachers in primary schools tend to develop problems as commonly as in the mathematics workbooks. In-service teachers tend to have better skills developing assessment items, but there were quite much of variability between individuals.

• 한국수학교육학회지시리즈C:초등수학교육
• /
• 제8권2호
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• 대한지구과학교육학회지
• /
• 제17권2호
• /
• pp.181-193
• /
• 2024

총괄평가는 학생들이 학습목표를 얼마나 잘 달성했는지에 대한 정보를 제공하므로, 정확한 평가를 위해서는 우수한 평가 문항을 개발해야 하며 이는 교사가 갖추어야 할 역량 중 하나이다. 본 연구는 초등 예비교사들이 총괄평가 문항을 분석하고 출제 의도와 문항 개발 과정의 어려움을 분석하고자 한다. 연구는 초등교사 양성 대학에 재학 중인 2학년 학생 45명을 대상으로 실시되었다. 3인 1조로 10개 문항을 개발하도록 하였고, 문항의 출제의도, 답안지, 문항 개발시 어려웠던 점을 작성하도록 요구하였다. 수집된 자료 중 총괄평가 문항은 Klopfer의 교육 목표 분류 체계가 포함된 이원목적분류표에 따라 평가 문항을 분석하였고, 총괄평가 출제 의도와 평가 문항 개발 시 어려웠던 점은 질적 자료 분석과정을 거쳐 귀납적으로 정리·분석하였다. 연구결과, 초등 예비교사들은 과학 내용 요소는 골고루 반영하고 있었으나, 문항 평가 영역에서는 골고루 반영하지 못했다. 가장 어려워했던 점은 난이도 조절이었다. 출제 의도에서는 문항 개발 시 고려해야 할 사항을 거의 대부분 고려하였으나 실제 개발된 문항에는 반영되지 않았다. 이러한 결과로부터 총괄평가 문항개발에는 지식과 경험이 중요하며 초등 예비교사들에게 체계적인 강의가 필요하다는 것을 제언한다.

• Human Ecology Research
• /
• 제62권2호
• /
• pp.197-216
• /
• 2024

The dual aims of this study were i) to explore the effectiveness of an assessment method that can measure the competencies learned through high school home economics and ii) develop a competency-based assessment framework for high school home economics, including components of competency-based assessment, item development system, and other elements. The study involved the following stages: literature analysis, draft development, concretization, validity verification, and final version. Based on the results of the literature analysis and expert deliberation, a competency-based assessment framework for high school home economics was developed which comprised three dimensions: 'core idea' × 'process' × 'context and value'. Based on this, an item analysis table was presented to systematize various activities for the competency-based assessment of high school home economics, following which a holistic rubric suitable for competency assessment tasks was proposed by referring to the newly developed 'process' dimension assessment criteria. This study is significant in that it is the first to propose a competency-based assessment framework that systematically presents a variety of assessment activities. These will facilitate the development of assessment standards and tools that teachers can refer to or trust in the changing school environment due to the introduction of the standard-based assessment system based on a high school credit system, and the guarantee of a minimum achievement level.

• 아동학회지
• /
• 제24권3호
• /
• pp.135-149
• /
• 2003

This study aimed to develop an observation scale for assessing the quality of day care programs and to examine reliability and validity of the scale. Instruments included 3 self-assessment scales, the Evaluation Scale for Early Childhood Programs and an observation scale completed by 8 trained observers in 89 day care sites. Item analysis indicated that most items were acceptable in terms of item discrimination and item response distribution. Cronbach ${\alpha}^{\prime}s$ and inter-observer reliability were relatively high. Validity of the scale was evidenced by correlations between the observation scale and the criterion measure and inter-correlations among sub-areas of the observation scale. Scores on the observation scale were validated by quality ratings from self-assessment scores.

• 의학교육논단
• /
• 제15권3호
• /
• pp.105-111
• /
• 2013

This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.

• 한국해양공학회지
• /
• 제24권2호
• /
• pp.74-81
• /
• 2010

Ship STEP is the international standard for the exchange of ship modeling data between heterogeneous systems. It is expected that STEP AP218 can be used for seamless data exchange between various CAD/CAM/CAE systems used in the shipbuilding design process. Although the conformance assessment for standards would maximize the performance and confidence about data exchanges, most research has been directed toward interoperability testing. ISO SC4/TC184 only provides the method for conformance testing, and it can be used with test cases on application protocols. Even though standards have been defined for conformance assessment and testing, there is no organization or association. CAD vendors have focused on interoperability testing for evaluation of the performance of their systems. In this paper, the conformance testing criteria for AP218 have been developed with abstract test cases of ship structures. The requested STEP translator was also reviewed with a developed item pool of testing criteria. The criteria methodology would be a guideline for the development of translators and interfaces. The item pool method of testing criteria for conformance assessment would increase performance and efficiency of data translators for Ship STEP and other standards.

• 과학교육연구지
• /
• 제37권2호
• /
• pp.348-358
• /
• 2013

과학교육에서 컴퓨터는 교수 학습 뿐 아니라 평가의 목적으로도 활용되고 있다. 죽, 컴퓨터의 장점을 살린 컴퓨터 기반 평가가 실시되고 있다. 그러나 이와 같은 평가는 주로 과정 중심이 아닌 결과 중심의 평가이며, 피험자의 수만큼 컴퓨터가 있어야 하므로 학교의 정규 시험으로 활용하기 곤란하다. 그러나 수행평가의 경우 일반적으로 평가 과제가 미리 공개되므로 학급별 또는 학생별로 평가 시간이 다르게 평가를 실시하는 것이 가능하다. 따라서 본 연구에서는 실제 실험기구를 사용한 실험평가를 대체할 수 있는 컴퓨터 기반 수행평가 문항을 개발하였다. 이를 위해 먼저 물리 교사를 대상으로 과학교육에 있어 이러한 기능에 대한 평가의 필요성 및 어려운 점 등에 대한 설문조사를 실시하였고, 이를 반영하여 전류계와 전압계를 포함한 회로를 구성을 하는 평가 문항을 개발하였다. 개발된 컴퓨터 기반 문항은 실제의 실험기구를 사용하여 진행되는 평가와 유사하게 구성하였으며 평가 과정에서 학생들의 수행에 따라 적절한 피드백을 제공하고, 수행 결과를 자동적으로 채점할 수 있도록 하였다. 이를 위해 컴퓨터가 학생들의 수행 결과의 정확성을 판단할 수 있는 알고리즘을 개발하였다.

• 한국임상보건과학회지
• /
• 제8권2호
• /
• pp.1426-1435
• /
• 2020

Objective: This study aims to develop CFT, a screening test for dementia that can be conducted on patients with mild cognitive impairment or early dementia. Methods: This study was conducted on therapists working at occupational therapy hospital in Gyeongsangnam-do. The data collection period is two months from July to September 2020, and the research participants were briefed on the purpose, significance, and anonymity of the research in consideration of ethical issues. A total of 33 copies of the data were finally analyzed, excluding those containing insufficient answers and errors, by distributing 40 copies of the data. SPSS Data Access pack 8.0 was used for data analysis, Cronbach's α value was evaluated for internal consistency reliability of each item, and Pearson Correlation coeffient between the lower scales of the assessment tool was measured. Results: The Cronbach's α value of the CFT was shown as .892 and the reliability of the assessment paper was shown to be quite high. The Cronbach's α value for each item in the cognitive assessment tool was the highest at .899 in the subtraction item, with exercise control (mook Chi Pa) at 888, visual memory, plus .887. The correlation of each item of cognitive assessment tools was found to be most correlated with the number of sustained concentrates and word2 to .934; in the stop word-numeric item and visual memory to be .85; and in the addition to the auditory memory item .739. Conclusion: Therefore, this study developed cognitive evaluation tools that can distinguish the diversity and cognitive level of screening tests and clarify standards, which are different from the existing dementia screening tools in Korea. Furthermore, the cognitive assessment tools of this study can be verified by applying them to patients with mild cognitive impairment and early dementia, and the criteria for generalization can be established.