• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.5
• /
• pp.316-324
• /
• 2016

The purpose of this study is to review existing research trends to find highly reliable tools for measuring inconsistencies in parenting attitudes for adolescent children. We reveal factors that heavily affect reliability and feasibility of these tools and compose stable measurement items. We found a total of 37 items with high reliability and feasibility comprising six questions on affection, three questions on childcare, nine questions on interest, seven questions on demands, five questions on neglect, and seven questions on abuse. We surveyed first to third-year high school students in public and private schools nationwide and carried out statistical analysis for the 1,020 respondents. Upon analysis, questions were removed if they showed low factor loading (less than 0.6) for the father and mother in each of the 37 measurement items. Only questions that could be used for both the father and mother were extracted to carry out exploratory factor analysis. Eight questions were were deleted: five on interest, one on demands, one on neglect, and one on abuse. The final 29 questions were selected for the measurement tool. Cronbach's Alpha coefficient was used to analyze reliability, which showed high reliability values ranging from .857 to .931 for the father and mother. Therefore, these inspection tools for inconsistent parenting attitude were both reliable and feasible.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• v.9 no.1
• /
• pp.91-97
• /
• 1998

Objectives：This study was designed for testing of Eating Attitude Test for Korean adolescents (EAT-26KA) on internal reliability and test-retest reliability and evaluation of each items through factor analysis. Methods：Total 1,160 middle and high school students were surveyed on June 1996. The questionnaire had been delivered by school teachers two weeks earlier before survey started. Among the 1,160 students, 114 students were selected by random. And then they were retested with same questionnaire on July 1996, four weeks later Result：Internal consistency of EAT-26KA was relatively good(Cronbach’s ${\alpha}$ =.83). There was statistically significance on test-retest reliability(r=.63 p<.01). But two items showed negative correlations(item No. 9, 17). and 5 items had low level correlation(p>.05, item No. 2, 6, 12, 21, 24). We performed factor analysis on whole items except No. 25 item. Result of factor analysis showed that the factor structure of EAT-26KA were different from that of EAT-26. Conclusion：The EAT-26KA is useful for the survey of the eating behavior and problems in Korean adolescents.

• Proceedings of The KACE
• /
• 2018.08a
• /
• pp.103-106
• /
• 2018

2015 개정 교육과정에서 컴퓨팅 사고력의 함양을 강조하고 있지만 컴퓨팅 사고력을 평가하기 위한 도구에 대한 개발이 미흡하다. 비버 챌린지 문항은 전 세계 60여개국의 정보 교육 전문가 집단이 약 1년 동안 공동 출제 및 검토를 통해 개발되는 문항이므로 문항의 타당도가 높다고 볼 수 있다. 다만 초기의 개발 목적이 평가도구로써 사용하기 위함이 아니었기 때문에 과연 컴퓨팅 사고력의 평가 도구로 사용할 수 있는 신뢰도를 가진 문항인가를 검증하기 위해 본 연구에서는 비버 챌린지 2017 그룹 III의 문항을 대상으로 문항내 적일관성신뢰도를 통계적으로 검증하였으며 그 결과 Cronbach ${\alpha}=.784$로 신뢰도가 높게 나타났다.

• The Journal of Korean Association of Computer Education
• /
• v.9 no.6
• /
• pp.11-18
• /
• 2006

The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

• The Mathematical Education
• /
• v.52 no.2
• /
• pp.231-245
• /
• 2013

MTEBI는 미국에서 초등 예비 교사들의 수학 교수 효능감을 측정하는데 자주 이용되는 척도이다. 이 연구의 목적은 MTEBI를 한국의 중등 예비 교사들에게 사용하는 것이 적합한지를 탐색하는 것이었다. 이를 위하여, 미국에 있는 대학원에 다니며 영어와 국어 둘 다 말할 수 있는 박사 학생 두 명이 MTEBI를 브리슬린의 이론대로 국문으로 번역하였고, 그 뒤에 한국에 있는 다수의 수학 교사 교육자들이 번역된 척도를 면밀하게 검토하였다. 한글판 척도를 먼저 작은 표본에서 초벌 실험하였는데, 두 개 문항이 도구의 신뢰도와 타당도를 현저하게 떨어뜨렸다. 본 연구에서는 이 두 개의 유용하지 못한 문항을 대신할 두 개 문항을 더한 23개 문항으로 구성된 척도에 대하여 정규성, 신뢰도, 요인 타당도 등을 658명의 표본에서 검사하였다. 초벌 연구에서 발견된 두 개의 유효하지 않는 문항은 본 연구에서도 역시 그와 같아서, 그 두 문항은 척도에서 제거되었다. 최종적으로 얻어진 21 문항 척도는 한국의 예비 수학 교사들의 수학 교수 효능감을 측정하는데 적합한 척도이다. 앞으로, MTEBI 한글판을 이용하여 한국에서 교사 효능감에 대한 연구가 활발하게 일어나기를 기대한다.

• 한국노년학
• /
• v.41 no.1
• /
• pp.149-168
• /
• 2021

This study was to develop the Medication Adherence Scale in Elderly (MAS-E) with chronic disease and verify its reliability and validity. The MAS-E was developed in 5 steps: Configuration of conceptual frame by content analysis, preliminary items, pilot study, reliability and validity test, and development of final MAS-E with chronic disease. The questionnaires were collected from 345 adults with one-to-one interviews. Verification of its reliability and validity was divided into two phases. Reliability was tested using Cronbach's alpha, split-halves reliability, and test-retest. For validity tests, item analysis, factor analysis, total score-factor score correlation analysis, and criterion related validity were used. The developed scale consisted of 18 items and 4 factors - remember of taking medication (2 items), expectations for drug effects (5 items), practice taking medication according to instructions (8 items), communicating with health professionals (3 items), and explained 69.7% of total variance. The scale had significantly positive correlation (r = .72, p <.001) with the Morisky Medication Adherence Scale (MMAS-8). Cronbach's alpha was .91, Guttman split half coefficient was .80, and test-retest reliability was .912. Finding suggest that the MAS-E is a suitable scale to assess the status of medication adherence in elderly with chronic disease.

• Journal of the Korean Society of Earth Science Education
• /
• v.9 no.3
• /
• pp.276-291
• /
• 2016

This study is to develop a valid and reliable instrument for measuring students' creative engineering problem solving propensity. The creative engineering problem solving is operationally defined in this study as a creative problem solving skill in an engineering context. To develop the instrument, first we define seven common constructs between engineering problem solving skill and creative problem solving skill through an intensive literature review; motivation, context, personal character, engineering design, engienering habits of mind, understandings of engineering and engineers, communication skill, and collaboration skill. Based on the seven constructs and the face validity test conducted by two in-service science teachers and 4 experts in science education research, 40 preliminary items were developed. Then the preliminary instrument was implemented in a science gifted highschool to measure the reliability of the instrument. From the 40 items, 34 items were selected through the initial reliability test by Cronbach's ${\alpha}$(>.75). Finally through the three times of factor analysis process, 28 items in five construct categories were selected; motivation (3 items), engineering design (6 items), engineering habits of mind (9 items), understandings of engineering and engineers (4 items), communication and collaboration skill (6 items). The factor analysis result showed that the reliability of each construct category was between .733 to .892., meaning that the instrument is reliable in terms of the higher structural validity (each item is categorized in an appropriate construct category). We expect that the creative engineering problem solving propensity instrument developed in this study can be used in various contexts for STEAM education research as a reliable and valid instrument.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Journal of the Korean Data and Information Science Society
• /
• v.22 no.3
• /
• pp.487-494
• /
• 2011

The purpose of this study was to investigate self-esteem item goodness-of-fit in sports talented children with socio-psychological aspect, which may be a basis of developing global sports leaders. Fifty children who were selected by 2010 sports talent identification program at Korea National Sport University participated in this study. All participants were asked to answer the questionnaire using Rogenberg (1965) self-esteem scale. Total 8 questions were used with 4 point Likert scale and high point stands for higher self-esteem status. Reliability of Cronbach's ${\alpha}$ was.785 in this study. Frequency analysis, descriptive statistics, and reliability analysis were conducted with SPSS 18.0. WINSTEPS 3.70 (Linacre, 2010) was used for calculating item goodness-of-fit and subject reliability, scale propriety, item goodness-of-fit and item level of difficulty, and level of difficulty were calculated. Statistical analysis showed results as follows. First, it was reported to be suitable for subject reliability in self-esteem as 1.01~1.03 and item reliability as 1.01~1.01. Second, 4 scale was suitable for scale propriety resulting from stage index judgment. Third, 2,7,8 and 3 question showed problems in item goodness-of-fit and item level of difficulty. Finally, scale propriety was reported to be inappropriate for considering sports talented children's ability distribution and scale level of difficulty.

• Communications for Statistical Applications and Methods
• /
• v.1 no.1
• /
• pp.206-214
• /
• 1994

본 논문은 1994학년도 부터 부활된 대학별고사 실시에 따른 문항분석, 표준 점수제 그리고 검사동등화의 문제점을 지적하기 위하여 교육측정이론의 기본 개념을 소개하는데 있다. 대학별고사의 타당성과 신뢰성을 보장받기 위하여는 양질의 문항제작이 우선하여야하며, 이를 위하여 문항분석은 종전에 사용하던 고전검사이론 보다는 문항반응이론을 이용하는 것이 바람직하다. 문항반응이론에 의한 문항분석은 피험자 집단의 특성에 의하여 문항특성이 달리 분석되지 않는 특징을 지니고 있기 때문이다. 문항이 논술형일 경우 채점자간 신뢰도와 채점자 내 신뢰도를 간과하여서는 안될 것이다. 다양한 선택과목을 채택하는 대학별 고사에서 입학 사정을 위하여 원점수를 사용하거나, 표준점수 혹은 검사동등화 방법을 이용하고 있으나 이는 교육측정이론에 위배된다. 다른 과목에 대한 인가의 능력을 상대비교 할 수 없으며, 표준점수와 검사동등화는 동일 능력에 대한 상대비교를 위한 방법이다. 특히 검사동등화는 동일 특성, 공정성, 모교집단 불변성, 대칭성을 전제한다. 표준점수제에 의하여 수험생들의 다른 능력을 상대 비교하는 방법은 다른 능력이 점수로 표현되기 때문에 가능하나 그 점수가 무엇을 의미하는 가를 분석할 때는 교육평가의 기본 철학에도 위배된다.