• 대한본초학회지
• /
• 제37권2호
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• 한국학교수학회논문집
• /
• 제10권1호
• /
• pp.113-127
• /
• 2007

본 고는 5년 간의 고등학교 연합학력평가자료 분석을 통하여 수리영역의 난이도 예측요인을 분석하였다. 난이도 예측을 위한 통계적 모형을 산출하기 위하여 먼저 문항분석을 통해 수리영역의 난이도 예측에 영향을 미칠 것으로 판단되는 주요 변인들을 '내용영역', '행동영역', '문항의 형식' 등의 범주에 따라 추출하였다. 추출된 독립 변인들에 대하여 단계선택방법을 사용한 다중회귀분석을 실시함으로써 정답률 예측에 유의미한 변수들을 선택하였으며, 교차 타당도를 통하여 최종적으로 선택된 예측 모형이 독립적으로 수집된 자료에 대하여 어느 정도의 설명력을 보이는지 검증하였다. 본 연구는 대학수능시험 출제나 현장에서 수리영역의 평가문항을 개발하는데 있어서 사전 정답률을 예측하는데 있어 고려해야 할 요인을 제시함으로써 보다 정확한 정답률 예측에 필요한 기초정보를 제공하는데 그 의의를 두고 있다.

• 대한간호학회지
• /
• 제39권2호
• /
• pp.259-269
• /
• 2009

Purpose: The aim of this study was to develop a breast feeding adaptation scale (BFAS) to evaluate adaptation to breastfeeding for breastfeeding mothers and their infants and to test the validity and reliability of the instrument. Methods: The study was conducted as follows: application of the conceptual framework, identification of the content domains, items generation, and test of validity and reliability. In order to test validity and reliability, two panels of experts reviewed items and subcategories of the preliminary questionnaire and then data were collected from 329 mothers who were up to 4 weeks postpartum and breastfeeding. Descriptive statistics, t-test, factor analysis, and Cronbach's alpha were used to analyze the data. Results: The conceptual framework was based on the Roy adaptation model. The content domains were developed via literature review, review of instruments, and data acquired from the interviews of breastfeeding mothers and nurses. A total of 69 items belonging to 8 domains were generated. A reduction to 44 preliminary items was accomplished through content validity analysis. Factor analysis extracted 8 factors with a total of 27 items on a 5-point Likert scale. Content validity, construct validity, criterion validity, and reliability of the BFAS were established. Conclusion: The newly developed BFAS is a reliable and valid instrument with which the adaptation of breastfeeding mothers and their infants to the breastfeeding behavior can be evaluated.

• 대한공업교육학회지
• /
• 제32권2호
• /
• pp.23-46
• /
• 2007

이 연구는 지금까지 출제된 공업계열 과목의 수능 문항을 대상으로 하여, 내용 영역 및 행동 영역 별로 문항을 분류 추출하고 각 영역 별로 고루 출제되고 있는지를 분석하여, 출제 경향 및 문제점을 파악하고 참신한 문항 개발 사례를 분석하여 공업계열 문항 개발에의 시사점을 제시하는데 그 목적이 있다. 이 연구의 목적을 달성하기 위하여 내용 영역 별로 문항을 분류하여 분석하고, 행동 영역 별로 예시 문항을 추출하여 분석하였으며, 참신한 문항 개발 사례를 선정하였다. 이를 통하여 얻은 주요 결론은 다음과 같다. 첫째, 내용 영역별 문항 분류를 통하여 출제 경향을 분석한 결과 비교적 중영역 별로 고르게 출제되었다. 둘째, 공업 입문은 입문적 성격이 강한 이론 과목의 특성이 있고 공업의 전반적인 내용을 포괄하고 있어 다른 과목에 비하여 비교적 시사적인 내용이 많이 출제되었는데, 교육과정과 관련된 시사적인 문항을 출제하였어도 당초 의도와는 전혀 다르게 문항에 제시된 정보만으로도 문제를 해결할 수 있는 문항이 많이 출제되었다. 셋째, 행동 영역의 하위 영역별로 예시 문항을 추출하여 분석한 결과 다양한 소재를 활용한 타당하고 참신한 문항이 많이 출제되었다. 이 연구를 수행하면서 나타난 문제점과 연구 결과를 토대로 앞으로 공업계열 수능 문항을 개발하는데 있어서 몇 가지 제언을 하면 다음과 같다. 첫째, 이 연구에서는 공업계열 모든 과목을 대상으로 하지 않고 공업 입문 과목에 한정하여 분석하였기 때문에, 기초 제도, 정보 기술 기초, 프로그래밍 등의 과목에 대한 후속 분석이 필요하다. 둘째, 행동 영역 별로 하위 영역을 통합하여 새로운 하위 영역을 지속적으로 개발하고, 하위 영역 분류 및 내용에 대한 타당성 검증 연구가 수행된다면 보다 참신하고 좋은 문항을 개발하는데 도움이 될 것이다.

• 지역사회간호학회지
• /
• 제19권2호
• /
• pp.247-259
• /
• 2008

Purpose: This study was conducted to develop a teacher-efficacy scale which is adequate for heath education teachers. Method: A preliminary questionnaire was made based on the hypothetical factors. A total of 364 health education teachers answered to the preliminary test, and the potential factors of teacher-efficacy were checked out by exploratory factor analysis (EFA). In the main test 378 health education teachers answered, the factor structure was drawn by EFA, and confirmatory factor analysis (CFA) was conducted to test and the fitness of the factor model. Results: Through the preliminary test, 5 potential factors were found, which were instruction, health-service, administrative task, interpersonal relationship, and community connection. Also, 48 items were reduced to 31 items. Through the main test, from the 34 items were extracted 4 factors with 24 items, And then teacher-efficacy scale was developed, which included the subscales of instruction efficacy, health-service efficacy, task-interpersonal efficacy, and community connection efficacy. Conclusion: Different from that for other subject teachers, the factor structure for health teachers had 4 factors with 24 items. The scale developed in this study is consistent with health teachers' work areas, and for this reason, has significance as a adequate and valid scale to measure teacher-efficacy of health education teachers.

• 한국수학사학회지
• /
• 제25권2호
• /
• pp.97-111
• /
• 2012

본 연구는 평가 문항에 대한 컨설팅 내용을 '교수에 필요한 수학적 지식 (MKT)'의 영역과 비교하여 '평가 문항 제작에 필요한 지식'의 영역을 알아볼 목적으로 2007년부터 2009년까지 A교육청의 컨설팅단에서 일선학교 교사들이 출제한 문항에 대해 컨설팅을한 내용을 수집하여 분석하였다. 이를 통하여 '평가 문항 제작에 필요한 지식'을 알아보았으며 교사들이 보다 질 높은 평가 문항을 제작할 수 있도록 하기 위해서는 문항 출제 관련 연수 및 컨설팅이 계속해서 이루어질 필요가 있다고 판단된다.

• 한국초등과학교육학회지:초등과학교육
• /
• 제18권2호
• /
• pp.21-33
• /
• 1999

The purpose of this study was to develop an Instrument for the Measurement of Cognitive Conflict Levels of students who confronted with an anomalous situation in science teaming. Anomalous situation is generated when students' prediction is disconsistent with the observed fact. In this study, the researchers identified 4 components of cognitive conflict and developed three items for each component. The items were developed and revised by four pilot tests. In the first pilot test, 55 elementary school students participated in the test In the second pilot test, 88 students of the 5th and 6th grader participated in the test. The instrument of measuring cognitive conflict levels was given to the subjects right after demonstrating anomalous situation. For the demonstration, two different problem situations were developed: one was a pulley problem and the other was electric bulbs in parallel. Answered reasons for each items were analyzed to assess students' understanding on each items. In third pilot test, 125 elementary school students participated in the test. A factor analysis of the responses was carried out and reliability of the test was assessed by calculating internal consistency values. The items were finalized by three pilot tests. After 1 month after the third pilot test, researchers conducted the finalized test items to 323 students of the 5th and 6th grader. The final instrument showed moderate reliability (Cronbach-α 0.82∼0.87) and good content validity(0.93). A factor analysis of the response was carried out. 4 main factors completely coincided with 4 components that we supposed to be the conducts of cognitive conflict. The instrument can provide a means for both teachers and researchers to assess the cognitive conflict of a large number of students within a single class period. The results can be used by teachers to better understand the process of conceptual change of their students and to match instruction and materials accordingly.

• 대한간호학회지
• /
• 제30권5호
• /
• pp.1333-1346
• /
• 2000

This study is a methodical research to develop a health behavior assessment scale for patients with rheumatoid arthritis, and to test the validity and reliability of the instrument. The research procedure was as follows; 1) The first step was to develop conceptual framework based on a comprehensive review of the literature, in-depth interviews patients with rheumatoid arthritis. This conceptual framework was organized in eight dimensions; pain management, exercise, rest, diet control, active committment, self-management, positive thinking, interpersonal maintenance. Initially 56 items were selected from 164 statement. 2) These items were reviewed by panel of eight specialists and the Index of Content validity (CVI) was calculated, and forty six items were selected which met more than 70% on the CVI. 3) 174 rheumatoid arthritis pateints were interviewed, and data was gathered from Jan. 25 to Feb. 18, 1999 for test reliabilities and validities of the scale. The item analysis was carried out and 40 items were selected. Factor analysis by varimax rotation was carried out to test construct validity. The internal consistency by chronbach's $\alpha$ was calculated. The findings were as follows; 1) Item analysis and factor analysis were carried out to test the validity of the health behavior assessment scale. The item analysis was based on the corrected item`s to total correlation coefficient (.30 or more), and information about the alpha estimate. However, this was only if this item was deleted from the scale. As a result of the item analysis, forty items were selected. Thirty items were selected by a initial factor analysis by varimax rotation, and ten items were deleted because of factor complexity. In the secondary factor analysis, eight factors were labled as 'positive thinking', 'exercise', 'rest', 'pain management', 'active committment', 'self-management', 'diet control', and 'interpersonal maintenance', each similar with the conceptual framework. 2) Chronbach's $\alpha$ coefficient to test reliability of the scale was. 903 for total the thirty items. The Scale for assessing health behavior developed in this study was identified to be a tool with a high degree of reliability and validity. Therefore this scale can be effectively utilized for assessment in the health behaviors of the patients with rheumatoid arthritis.

• 동의신경정신과학회지
• /
• 제26권2호
• /
• pp.143-160
• /
• 2015

Objectives: The study purpose was to test the validity and reliability of the core emotional assessment questionnaire based on the seven emotions. Methods: Survey data were from 651 individuals and contained 141 items determined from a previous pilot study. Among the participants, 241 were retested. First, following analysis of the internal consistency reliability of the 141 items, we deleted items with Cronbach-$\alpha$ coefficient below 0.5. We then selected 100 final items after the first factor analysis. Second, the final 100 items were evaluated by internal consistency reliability, test-retest reliability, factor analysis, and correlational analysis. Results: Cronbach-$\alpha$ coefficient for the final 100 items were 0.866~0.956 and the test-retest reliability were above 0.70. The 100 items categorized into 7 factors explained 53.8% of the total variance. Analyzing the correlation of each chiljeong, we had a high positive correlation above 0.70 between sa and bi, bi and u, gong and kyeong. Conclusions: The final 100 items used for the core emotional assessment questionnaire based on the seven emotions showed satisfactory reliability and validity. Thus, it may be an appropriate instrument for measuring Chiljeong in the general population.

• 컴퓨터교육학회논문지
• /
• 제10권6호
• /
• pp.29-38
• /
• 2007

이 연구의 목적은 아동의 온라인 게임 중독 성향을 측정하기 위한 한국형 검사 척도를 과학적인 절차에 따라 개발하는 것이다. 3차례에 걸쳐 실시된 예비검사에서 문항 분석, 신뢰도 분석, 요인 분석이 수행된 결과 30문항으로 구성된 본 검사척도가 결정되었다. 본 검사에서는 준거타당도 검증을 위하여 온라인 게임 이용 실태 및 태도와 더불어 심리적 변인 4가지인 공격성 척도, 충동성 척도, 외로움 척도, 자기 통제력 척도를 포함하였고, 전국 초등학교 5, 6학년 2,584명의 학생이 조사에 참여하였다. 본 검사 결과에 대하여 문항 분석, 신뢰도 분석이 수행되었고, 탐색적 요인 분석과 준거 변인과의 상관 분석에 의해 타당도가 검증되었다. 마지막으로, 표준화 절차를 통해 7개 하위요인, 30문항으로 구성된 최종 검사 척도와 중독 집단 분류 규준을 개발하였다.