• Title/Summary/Keyword: Item difficulty

Search Result 285, Processing Time 0.024 seconds

The Development and Validation of a Musicality Rating Scale for Young Children (유아 음악성 평가척도 개발 및 타당화 연구)

  • Yun, Hyun Jeong;Shin, Nary
    • Korean Journal of Childcare and Education
    • /
    • v.15 no.3
    • /
    • pp.175-201
    • /
    • 2019
  • Objective: This study aims to develop and validate the musicality level of an individual child, based on the on performance tasks rubrics. Methods: The survey was conducted on 284 children(ages 3-5years old from kindergartens and day care centers), their parents, and their 51 teachers. The collected data were calculated and analyzed using SPSS 22.0 and AMOS 22.0. Results: Consisted of two components, two task types, 17 performance tasks, and 41 items in three dimensions. Rubrics were determined and based on the child's best performance, and categorized into five levels. Lastly, the item difficulty and item discriminating power were defined in order to comprehend the item quality analysis, which showed that average scores varied depending on the performance. Conclusion/Implications: The musicality rating scale for young children is significant in order to comprehend musicality levels through the performances of children aged three to five. This study has educational implications in that teachers can connect the results of the ratings to curriculum and promote the development of teaching and learning methodologies based on the musicality levels of individual children.

Analysis of Korea Earth Science Olympiad Items for the Enhancement of Item Quality (한국 지구과학 올림피아드 문항 분석을 통한 문항의 질 향상 방안)

  • Lee Ki-Young;Kim Chan-Jong
    • Journal of the Korean earth science society
    • /
    • v.26 no.6
    • /
    • pp.511-523
    • /
    • 2005
  • The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

Examination Questions Selection Algorithm in Web-based Engineer Test Education System (웹 기반 기사시험 학습 시스템에서의 문제 출제 알고리즘)

  • Kim Eun-Jung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.9 no.3
    • /
    • pp.11-18
    • /
    • 2004
  • It is making researches in questions selection method for examination in web-based education system. Most questions made for these remote examinations use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. This paper proposes a new examination questions selection algorithm in web-based education system for engineer test. Generally, Engineer test is characterized by adequate examination questions selection for degree of difficulty and equally between all units. Therefore this algorithm selected examination questions equally well as regards degree of difficulty and distribution between all units. This algorithm providers more effective education examination method as compared with previous algorithm.

  • PDF

Analysis of Mathematical Problem Based on Mathematical Problem Solving Competency (수학적 문제해결역량을 위한 평가 문항의 조건과 그 실제)

  • Lee, Seon Yeong;Lee, Ji Soo;Han, Sunyoung
    • The Mathematical Education
    • /
    • v.57 no.2
    • /
    • pp.111-136
    • /
    • 2018
  • This study suggests a framework for analyzing items based on the characteristics, and shows the relationship among the characteristics, difficulty, percentage of correct answers, academic achievement and the actual mathematical problem solving competency. Three mathematics educators' classification of 30 items of Mathematics 'Ga' type, on 2017 College Scholastic Ability Test, and the responses given by 148 high school students on the survey examining mathematical problem solving competency were statistically analyzed. The results show that there are only few items satisfying the characteristics for mathematical problem solving competency, and students feel ill-defined and non-routine items difficult, but in actual percentage of correct answers, routineness alone has an effect. For the items satisfying the characteristics, low-achieving group has difficulty in understanding problem, and low and intermediate-achieving group have difficulty in mathematical modelling. The findings can suggest criteria for mathematics teachers to use when developing mathematics questions evaluating problem solving competency.

Analysis of Science Items of the Japanese National Center Test for University Admissions (일본 대학입시센터시험 이과 문항 분석)

  • Kim, Hyun-Kyung;Kim, Dong-Young;Choi, Hyuk-Joon;Ku, Ja-Ok;Dong, Hyo-Kwan;Shin, Il-Yong;Lee, Yang-Rak
    • Journal of The Korean Association For Science Education
    • /
    • v.30 no.4
    • /
    • pp.452-471
    • /
    • 2010
  • As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.

Domestic Occupational Therapist Awareness Survey for the Need to Apply Artificial Intelligence Measurement Technology for Clinical Observation Evaluation Based on Sensory Integration (감각통합에 기초한 임상 관찰 평가의 AI 측정 기술 적용 필요성을 위한 국내 작업치료사 인식 조사)

  • Cho, Sun-Young;Jung, Young-Jin;Kim, Jung-Ran
    • Therapeutic Science for Rehabilitation
    • /
    • v.12 no.1
    • /
    • pp.23-35
    • /
    • 2023
  • Objective : This study is to examine the practical use of clinical observational evaluation of sensory integration therapy and the difficulty and importance of measuring results for each sub-item, and through this, to confirm the usefulness of the application of Artificial Intelligence measurement technology in clinical observational measurement and the need for application. Methods : The questionnaire consisted of the actual use of the sensory integration evaluation tool, the difficulty of measurement for each detailed item of clinical observation, the usefulness of AI measurement technology, the importance of evaluation for each detailed item, and the need for developing AI measurement technology. Results : The detailed items that were difficult to measure during clinical observation were the Finger-to-Nose Test and Postural control (71.0%), followed by Eye movement and Protective Extension Test (67.7%). 83.9% of the study subjects answered that it would be useful to apply AI measurement technology when observing images. Postural control (on the ball) (90.3%) was the highest item that answered that AI measurement technology was needed, followed by Eye movement (83.9%), and Prone Extension and Protective Extension Test (77.4%). Conclusion : The results confirmed the desire of therapists that clinical observation is an important evaluation tool in the field of child occupational therapy in Korea.

Industrial Fatigue due to Banking Operations with VDT (은행원의 VDT작업에 따른 피로자각증상)

  • Koo, Jung-Wan;Lee, Seung-Han
    • Journal of Preventive Medicine and Public Health
    • /
    • v.24 no.3 s.35
    • /
    • pp.305-313
    • /
    • 1991
  • In order to investigate industrial fatigue due to visual display terminal (VDT) work of banking operations the questionnaire survey for subjective symptoms of fatigue was carried out on 470 bank clerks who had been engaged in VDT work for various length of work hours. The questionnaires comprised three groups of 10 items each, representing dullness and sleepiness (level of cerebral activation), difficulty in concentration (level of motivation) and bodily projection of fatigue. The results were as follows : 1. Of the 30 items of questionnaires, the highest percentage was accounted for by 'eye strain' (51.5% ), followed by 'feel stiffness in the neck or the shoulders'(33.4%), 'feel a pain in the low back'(26.8%), 'whole body feels tired'(19.6%) and 'feel headache'(17.9%) in the order of sequence. 2. The average weighted score for the first group of questionnaire items (dullness and sleepiness) was the largest among three groups and was followed by 'the third cup (bodily projection of fatigue) and the second item group (difficulty in concentration) in the order of sequence, suggesting the heavier mental stress of VDT work in banking operations rather than physical burden. 3. In terms of the age and sex of workers, work duration and VDT work percentage, the difference in average weighted score was noted only between sex, the score of female being larger than that of male. 4. The complaint rates of subjective symptoms showed close associations with the subjective optimums of room temperature, ventilation, illumination and noise level. 5. The significant correlation was showed between age, work duration and item of 'whole body feels tired', between VDT work percentage and items of 'eye strain' and 'feel stiffness in the neck or shoulders' and between all items of subjective symptoms.

  • PDF

A Study on Students' Thinking Processes in Solving Physics Problems (물리 문제 해결 과정에서의 학생들의 사고 과정에 관한 연구)

  • Park, Hac-Kyoo;Kwon, Jae-Sool
    • Journal of The Korean Association For Science Education
    • /
    • v.14 no.1
    • /
    • pp.85-102
    • /
    • 1994
  • The purpose of this study was to analyze students' physics problem solving processes and to find the patterns of their problem spaces when high school and university students solved the physics problems. A total of 51 students in a high school and in two universities participated in this study. Their thinking processes in solving 5 physics problems on electric circuit were recorded by using 'thinking aloud' method and were transferal into protocols. 'The protocols were analyzed by the coding system of problem solving process. One of the major theoretical contributions of the computer simulation approach to problem solving is the idea of problem space. Such a concept of problem space was applied to physics problems on electric circuit in this study, and students' protocols were analyzed by the basic problem spaces which were made up from the item analysis by the researcher. The results are as follows: 1) On the average 4.0 test items among 5 ones were solved successfully by all subjects, and all of the items were solved correctly by only 19 persons among all of them. 2) In regard to the general steps of problem solving process, there was little difference for each item between the good solvers and the poor ones. But according to the degree of difficulty of task there was a good deal of difference. For a complex problem all of 4 steps were used by most of students, but for a simple one only 3 steps except evaluating step were used by most of them. 3) It was found in this study that most of students used mainly the microscopic approach, that is, a method of applying Ohm's law on electric circuit simply and immediately, not using the properties of electric circuits. And also it was observed that most of students used the soloing tom below, that is, a solving path in which they were the first to calculate physical Quantities of circuit elements, before they caught hold of the meaning of the given problem regardless of the degree of difficulty.

  • PDF

Study on Estimating the Optimal Number-right Score in Two Equivalent Mathematics-test by Linear Score Equating (수학교과의 동형고사 문항에서 양호도 향상에 유효한 최적정답율 산정에 관한 연구)

  • 홍석강
    • The Mathematical Education
    • /
    • v.37 no.1
    • /
    • pp.1-13
    • /
    • 1998
  • In this paper, we have represented the efficient way how to enumerate the optimal number-right scores to adjust the item difficulty and to improve item discrimination. To estimate the optimal number-right scores in two equivalent math-tests by linear score equating a measurement error model was applied to the true scores observed from a pair of equivalent math-tests assumed to measure same trait. The model specification for true scores which is represented by the bivariate model is a simple regression model to inference the optimal number-right scores and we assume again that the two simple regression lines of raw scores and true scores are independent each other in their error models. We enumerated the difference between mean value of $\chi$* and ${\mu}$$\_$$\chi$/ and the difference between the mean value of y*and a+b${\mu}$$\_$$\chi$/ by making an inference the estimates from 2 error variable regression model. Furthermore, so as to distinguish from the original score points, the estimated number-right scores y’$\^$*/ as the estimated regression values of true scores with the same coordinate were moved to center points that were composed of such difference values with result of such parallel score moving procedure as above mentioned. We got the asymptotically normal distribution in Figure 5 that was represented as the optimal distribution of the optimal number-right scores so that we could decide the optimal proportion of number-right score in each item. Also by assumption that equivalence of two tests is closely connected to unidimensionality of a student’s ability. we introduce new definition of trait score to evaluate such ability in each item. In this study there are much limitations in getting the real true scores and in analyzing data of the bivariate error model. However, even with these limitations we believe that this study indicates that the estimation of optimal number right scores by using this enumeration procedure could be easily achieved.

  • PDF

Comparison of Kinesthesia Test of SIPT for Preschool Children (전 학령기 아동의 SIPT 운동감각(kinesthesia) 검사에 대한 비교 연구)

  • Chang, Moon-Young;Hwang, Ki-Chul
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.2 no.1
    • /
    • pp.11-19
    • /
    • 2004
  • Objective : This study is to provide the norms of normal children when comparing the performance ability of preschool children while using the kinesthesia test of Sensory Integration and Praxis Tests(SIPT). Methods : Participants consisted of 90 normal children ranging in age from four to six years. The kinesthesia test of SIPT was utilized to investigate the performance ability. Results : 1. Regarding the kinesthesia ability according to age, the average value of kinesthesia performance error decreased as age getting older and that value showed the statistically significant differences between four and five, six age(p<0.05). 2. The kinesthesia performance ability according to gender, the accuracy of both hands and the dominant hand did not show the statistically significant differences. 3. Regarding the kinesthesia performance ability of test items, 1R item and 6R item(26.2cm), 5R item and 2L item(20.2cm) passing through the midline of body and having the large movement in distance and angle showed the difficulty to perform in all the children between 4 and 6 age. Conclusion : By providing the norms of the kinesthesia performance ability in normal children of the above results to the occupational therapists treating children, the helpful data to the hand skill development of children, exercise plan and implementation, and the performance therapy of ADL through the proper evaluation and training of kinesthesia is considered for the occupational therapists to be provided.

  • PDF