• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.601-615
• /
• 1998

Establishing and evaluating science education policies and revising and monitoring the effectiveness of science curriculum should be based upon the results of systematic and scientific research studies. Advanced nations have already been administering and developing national level science assessments for these purposes. The science assessments administered in Korea have been reported having many limitations and problems, and not succeeded in providing data for science education policy making and curriculum reform. The major purpose of the study is developing national level science knowledge assessment system in order to identify longitudinal trends of elementary and secondary school students science knowledge achievements. The research team consisted of science education experts and teachers from various school levels, decided the directions and major elements of national level science knowledge assessment with the consultation of educational evaluation experts. Item developing ability of the researchers was improved by seminars? and workshops on national assessment in advanced nations and developing skills of writing science items. Nearly 500 items were developed and revised. Pilot test was administered with 958 students at various school levels. 380 items were selected and tested with 8766 students, and the characteristics were analyzed in terms of item response theory. The target populations for national level science knowledge assessment are 5th-grade of elementary school, 2nd-grade of middle school, 1st and 2nd-grade of high school students. The proper period for the assessment is February every year. Multi-stage clustered sampling method is desirable and rotated forms are recommendable for the test format. Bridge items should be introduced to compare the results of multiple tests, and various grades. Anchor items should also be used for longitudinal interpretations of the results. The items for elementary school require low to medium abilities, for middle school and first grade of high school require medium to high abilities and for 2nd-grade of high school high abilities. The discrimination ability of the items developed is high.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.34 no.6
• /
• pp.1837-1844
• /
• 2014

The study of safety culture estimate has received a wide attentions in many other industries, rather in the contexture of railroad stands at an initial phase. A factor analysis and internal reliability test were conducted to check if the survey results are reliable by looking at how the factors are dimensioned and how the questionnaires are sub-grouped in accordance with such factors, and further if there are any other common attributes being extracted as a new factor. The designed 5 factors were expanded to 7 through the test, and they were renamed accordingly. The questionnaires are reorganized according to the new 7 factors. It implicates that thorough investigation of the common attributes is important in reducing the gaps between interviewers' and interviewees' understanding. Moreover, the results of internal reliability test represent the new design of questionnaire is reasonably acceptable with the high reliable values. We expect such approaches can be applied for the railway culture survey study to be more reliable and applicable.

• Journal of Internet Computing and Services
• /
• v.8 no.6
• /
• pp.127-133
• /
• 2007

The u-learning environment has been developed through a number of iterations, and has now been formally evaluated, through analysis of student learning results and the use of quantitative and qualitative measures, Generally, for advance learning effect and analysis of student learning results, the most learning system be use to the item analysis method. But, nowadays, it has using the IRT(Item Response Theory) instead of the item analysis method, The IRT adopts explicit models for the probability of each possible response to a test. Therefore, I proposed the lightweight component based u-learning system using the IRT. Applied device of u-learning is PDA which is in Windows mobile 5.0 environments.

• Journal of the Korean association of regional geographers
• /
• v.23 no.1
• /
• pp.195-212
• /
• 2017

This study analyzed on the content validity of the Korean geography subject evaluation questions on the College Scholastic Ability Test(CSAT) from 2014 to 2016 regarding the national curriculum achievement standards. The main results are as follows. First, from 'the knowledge dimension' aspect, both the achievement standard and the CSAT questions showed the highest ratio of 'factual knowledge'. Second, from 'the cognitive process dimension' aspect, the percentage of 'understand' was the highest in the achievement standard, whereas in the CSAT questions, the ratio of 'analyze' and complex type of 'analyze' and 'understand' was the highest. Third, in the result of the analysis of the content validity of the Korean geography CSAT questions through proportion test, all of the analysis targets showed 'a little low'. Finally, the content validity analysis showed that there was a significant difference between the main types of the achievement standards and the CSAT questions in the 'Geomorphological Environment and Ecosystem part' and 'Space of Production and Consumption part' from the cognitive process aspect, which showed relatively low content validity compared to other areas. The results of this study suggest that the achievement standards should be reflected on the Korean geography CSAT questions and it should not be focused on evaluating the learner's analysing ability.

• Journal of the Korean School Mathematics Society
• /
• v.8 no.1
• /
• pp.1-17
• /
• 2005

The purpose of this paper was to investigate the mathematical knowledge and perspective of elementary school teachers in the development and evaluation of students' mathematical tests, analyse test questions, and suggest several principles for the several issues of making and evaluating test-questions. The researcher surveyed 268 elementary school teachers who attended a teachers training program at the A university during January, 2005. The data were analysed by the patterns. The patterns were ambiguity or uncorrectly-described test questionnaires, wrong interpretation of students' responses by the teachers, teacher's deficiency of student' levels and perspectives of mathematics, problematic questionnaires against test-making method, and so forth. Teachers are encourages to cross check to avoid the above problems, to have a strong mathematical knowledge, and to see students' mathematical answers in a flexible manners.

• 한국노년학
• /
• v.41 no.1
• /
• pp.149-168
• /
• 2021

This study was to develop the Medication Adherence Scale in Elderly (MAS-E) with chronic disease and verify its reliability and validity. The MAS-E was developed in 5 steps: Configuration of conceptual frame by content analysis, preliminary items, pilot study, reliability and validity test, and development of final MAS-E with chronic disease. The questionnaires were collected from 345 adults with one-to-one interviews. Verification of its reliability and validity was divided into two phases. Reliability was tested using Cronbach's alpha, split-halves reliability, and test-retest. For validity tests, item analysis, factor analysis, total score-factor score correlation analysis, and criterion related validity were used. The developed scale consisted of 18 items and 4 factors - remember of taking medication (2 items), expectations for drug effects (5 items), practice taking medication according to instructions (8 items), communicating with health professionals (3 items), and explained 69.7% of total variance. The scale had significantly positive correlation (r = .72, p <.001) with the Morisky Medication Adherence Scale (MMAS-8). Cronbach's alpha was .91, Guttman split half coefficient was .80, and test-retest reliability was .912. Finding suggest that the MAS-E is a suitable scale to assess the status of medication adherence in elderly with chronic disease.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.321-327
• /
• 2013

Impaired naming difficulty is common in normal elderly as well as in patients with neurological impairment. The 60-item Korean version-Boston Naming Test(K-BNT) is one of the most commonly used test for measuring confrontational naming ability. However, age-related cognitive decline may make the elderly difficult concentrating during the 60-item test, therefore, item reduction of the K-BNT would improve test validity and reliability. Thus, the purpose of this study was to develop a short form of the K-BNT based on Item Response Theory(IRT). Considering item-fit index, sex factor, and item difficulty through Rasch analysis, the 15-item K-BNT(i.e., K-BNT-15) was developed. Via administration of the K-BNT-15, we observed age-related decline in naming ability and significantly different performance between the normal elderly and patients with mild cognitive impairment. This study demonstrates the utility of IRT for developing a short-form language evaluation tool. The K-BNT-15 can be effective as a language screening tool to differentiate between normal aging and pathological diseases.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1998.10a
• /
• pp.492-497
• /
• 1998

본 논문에서는 기존의 교사 주도적이고 획일화된 주입식 교육 방식의 문제점을 해결하기 위한 수준별 학습평가시스템을 제안한다. 수준별 학습을 위한 교육평가의 문항분석에 퍼지이론을 적용하여 평가문항을 수준별로 분류하고 학습자의 수준에 따라 문제를 선정하여 평가할 수 있다. 따라서 학습자의 개인차를 정확하게 파악하고 개별 학습지도를 할 수 있으므로 학습자의 능력을 향상 시킬 수 있다.

• Journal of the Korean School Mathematics Society
• /
• v.26 no.2
• /
• pp.137-158
• /
• 2023

This study aimed to analyze the shifts in the mathematics domains of the College Scholastic Ability Test (CSAT) since its inception in 1993, with the intent of identifying improvements for the future. The goal is to provide insights for exploring the direction of assessment in Korean high school mathematics education. To this end, we focused on the test system, content area, and behavioral area within the CSAT mathematics domains. Key findings include: first, the test structure influences the assessment factors and item types, in addition to the examination time and number of items. Second, by analyzing the content area, we established a correlation between the national curriculum and assessment area, and confirmed the importance of setting the assessment area. Third, the examination of the behavioral area tended to the item-type fixation, demonstrating the necessity of the ongoing modifications in evaluation item types. Building upon these findings, we discuss the direction of an evaluation that considers the evolving demands and shifts within mathematics education.

• Journal of Educational Research in Mathematics
• /
• v.24 no.2
• /
• pp.253-267
• /
• 2014

This study aims to analyse the effectiveness of the mathematics teacher's training program: whether the training program is effective to improve mathematics teachers' professional competency of the developing assessment instrument (including items) or not. The teachers who were attendee of the program did pre-test before the program and post-test after the program. They wrote the opinions on the pre-developed items which had many errors in the beginning and discussed their opinions each others in the middle of program. The differences between pre-test and post-test and between opinions in the beginning and in the middle were analysed. The first result of the study is that the teacher's professional competency which is evaluated as self-perceived points is improved with regard to understanding the standardized test, item difficulty and item discrimination. Secondly, the proportion of the opinion with concrete reasons is increased as the program progressed. Thirdly, the effective elements of the program are the discussion in the group, discussion between groups, and feedback from the instructor. But the ineffective element of the program is the insufficient time for practicing.