• Education of Primary School Mathematics
• /
• v.8 no.2 s.16
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• Journal of Science Education
• /
• v.37 no.2
• /
• pp.278-293
• /
• 2013

The purpose of this study was to analyze the characteristics of multiple-choice test items used in assessment of high school integrated science according to 2009 revised curriculum. For the analysis of the tendency of item setting, we devised an analytic framework specific to integrated science, and analyzed the characteristics of items by applying the devised framework and item response theory. The results of the tendency of item setting revealed that most of items run counter to the intent of integrated science in terms of item resource, integration extent, and cognitive level, which means teachers are stick to separative method in teaching-learning and assessment of integrated science. The results of the analysis applying item response theory showed that item difficulty was appropriate and item discrimination was considerably high. However, there was no relevance between the tendency of item setting and qualitative characteristics of the items. We also discussed some agendas to improve the teaching-learning and assessment of integrated science based on the results of this study.

• Physical Therapy Korea
• /
• v.23 no.2
• /
• pp.35-43
• /
• 2016

Background: The Functional Gait Assessment (FGA) was developed to measure of gait-related activities. The FGA was translated in Korean but only a few psychometric characteristics had been studied. Objects: The purpose of this study was to evaluate the validity and reliability of the Korean version of FGA scale using Rasch analysis. Methods: The study included 120 patients with stroke (age range=30~83 years; mean${\pm}$standard deviation=$58.3{\pm}11.1$). The FGA and Berg Balance Scale were performed, and were analysed for dimensionality of the scale, item difficulty, scale reliability and separation, and item-person map using Rasch analysis. Results: The 4 rating scale categories of FGA were satisfied with optimal rating scale criteria. The most items of the FGA showed sound item psychometric properties except 2 items ('gait with the horizontal head turns', and 'gait with narrow base of support'), and the 2 misfit items were excluded for all further analyses. The 8 items were arranged in order of difficulty. The most difficult item was 'gait with eyes closed', the middle difficult item was 'gait level surface', and the easiest item was 'gait with vertical head turns.' A person separation reliability was .93 and the person separation index was 3.57. Conclusion: This study suggests that the 8-item Korean FGA are valid measure of assess the gait-related balance performance, and to set the goal of rehabilitation plan in patient with stroke.

• Korean Journal of Child Studies
• /
• v.23 no.4
• /
• pp.199-213
• /
• 2002

This preliminary study aimed to develop 3 assessment scales for self-evaluation by day care directors and teachers. The development of major areas of evaluation and items as well as evaluation criteria for each item was based on the analysis of related research and major evaluation instruments. A panel of experts in early childhood education examined the contents. The 3 preliminary scales were administered in 87 day care centers; data were analyzed by item response distribution, item discrimination, and reliability of the scales. Items indicating low item discrimination were deleted and minor revisions were made to improve psychometric characteristics of each scale. The final version of the 3 scales is valid for use as self-evaluation instruments by day care directors and teachers.

• The Journal of Korean Association of Computer Education
• /
• v.15 no.6
• /
• pp.33-41
• /
• 2012

This paper presents the online assessment questions management system and method. The proposed system consists of a database to store learner information and zone-specific items grouped by difficulty and item bank. This database includes: an item selection department and authoring assessment to select questions about a particular learner or specific learning item. In this paper, we propose: an item bank database which stores online output assessments; and an online test department to collect and sort learner evaluation data and answer selection order for online tests, click statistics, response time, and analysis unit response patterns department by analyzing the data collected by the online learners' test assessment, learners' level and ability, the diagnosis and assessment of report propensity. The proposed system will diagnose and effectively evaluate the learner's learning levels and learning ability by: answer selection order, number of clicks, and response time reflected in the results of the learners' evaluations.

• Current Research on Agriculture and Life Sciences
• /
• v.26
• /
• pp.7-15
• /
• 2008

This research is significant in terms of estimating the validity by setting evaluation items in view of integrating not only original beauty and visual areas but also natural ecological areas based on questionnaire. The results are as follows. 1) According to literature study, 17 items such as variety, the character of sites in terms of landscape, the beauty of landscape, visibility, and ratio of green visibility are selected. Also, 21 items such as variety of animals and plants species, size of green area, and ecological naturalness are selected in the area of landscape ecological resources. 2) As a result of questionnaire of the group of landscape experts, animals and plants ecological areas show 5.6341, the highest in importance analysis according to assessment areas. Also, as a result of importance analysis on items in each area, for example, in the area of visual resources, the item of skyline analysis is 6.0488, the highest. 3) As a result of corelation of item meaning on landscape effect assesment, for example, meaningness of psychological assessment item and landscape site item indicate 0.710, the highest coefficient correlation. 4) As critical assessment items per unit project, items such as damage minimization of original land features for project in terms of point, ratio of green visibility, variety of animals and plants species marked above 8.0 as high important medium. The project in terms of line, minimization of original land features, preservation of worthy biotope showed high point and the character of sites in terms of landscape, minimization of original land features, the size of green area, and analysis of skyline marked above 8.5 as high importance points. On the contrary, items for climate and soil showed relatively low points.

• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• Human Ecology Research
• /
• v.62 no.2
• /
• pp.197-216
• /
• 2024

The dual aims of this study were i) to explore the effectiveness of an assessment method that can measure the competencies learned through high school home economics and ii) develop a competency-based assessment framework for high school home economics, including components of competency-based assessment, item development system, and other elements. The study involved the following stages: literature analysis, draft development, concretization, validity verification, and final version. Based on the results of the literature analysis and expert deliberation, a competency-based assessment framework for high school home economics was developed which comprised three dimensions: 'core idea' × 'process' × 'context and value'. Based on this, an item analysis table was presented to systematize various activities for the competency-based assessment of high school home economics, following which a holistic rubric suitable for competency assessment tasks was proposed by referring to the newly developed 'process' dimension assessment criteria. This study is significant in that it is the first to propose a competency-based assessment framework that systematically presents a variety of assessment activities. These will facilitate the development of assessment standards and tools that teachers can refer to or trust in the changing school environment due to the introduction of the standard-based assessment system based on a high school credit system, and the guarantee of a minimum achievement level.

• Physical Therapy Korea
• /
• v.18 no.3
• /
• pp.94-102
• /
• 2011

The purpose of this study was to review existing assessment tools for patients with low back pain and improve them through combination. A total of 314 patients with low back pain participated. Their condition was assessed using the Oswestry Disability Questionnaire (ODQ), the Quebec Back Pain Disability Scale (QBPD), and the Back Pain Functional Scale (BPFS). Rasch analysis was applied to identify inappropriate items, item difficulties, and the separation index. In this study, the 'sex life' item of the ODQ (10 items) and the 'sleeping' item of the BPFS (12 items) showed misfit statistics, whereas all items of the QBPD (20 items) were appropriate. After combining the ODQ, QBPD and BPFS, Rasch analysis was applied. The 'pain intensity', and the 'sex life' item of the ODQ and the 'throw a ball' item of QBPD showed misfit statistics. These 3 items were retained for further analysis. The remaining 42 combined ODQ-QBPD-BPFS items were arranged according to difficulty. For all subjects, the most difficult item was 'pain intensity', whereas the easiest was 'take food out of the refrigerator'. As the separation index of 42 combined ODQ-QBPD-BPFS was higher than that of the three questionnaires separately, difficulty of items varied with some need for rearrangement. The results of this study confirmed the possibility and need for a new back pain disability assessment tool, and produced one. Further study is needed to refine the questionnaire in consideration of psychosocial and occupational factors.

• Korean Medical Education Review
• /
• v.20 no.1
• /
• pp.20-31
• /
• 2018

Good assessment is crucial for feedback on curriculum and to motivate students to learn. This study was conducted to perform item analysis on the Medical Education Assessment Consortium clinical knowledge mock examination (MEAC CKME) (2011-2016) and to evaluate several effects to improve item quality using both classical test theory and item response theory. The estimated difficulty index (P) and discrimination index (D) were calculated according to each course, item type, A (single best answer)/R (extended matching) type, and grading of item quality. The cut-off values used to evaluate P were: >0.8 (easy); 0.6-0.8 (moderate); and <0.6 (difficult). The cut-off value for D was 0.3. The proportion of appropriate items was defined as those with P between 0.25-0.75 and D ${\geq}0.25$. Cronbach ${\alpha}$ was used to assess the reliability and was compared with those of the Korean Medical Licensing Examination (KMLE). The results showed the recent mean difficulty and decimation index was 0.62 and 0.20 for the first MEAC CKME and 0.71 and 0.19 for the second MEAC CKME, respectively. Higher grade items evaluated by a self-checklist system had better D values than lower grade items and higher grade items gradually increased. The preview and editing process by experts revealed maintained P, decreased recall items, increased appropriate items with better D values, and higher reliability. In conclusion, the MEAC CKME (2011-2016) is deemed appropriate as an assessment to evaluate students' competence and prepare year four medical students for the KMLE. In addition, the self-checklist system for writing good items was useful in improving item quality.