• 컴퓨터교육학회논문지
• /
• 제15권6호
• /
• pp.33-41
• /
• 2012

본 논문은 온라인 평가 문항 관리 시스템 및 방법에 관한 것이다. 제안하는 시스템은 학습자 정보 데이터베이스, 영역별, 난이도별로 분류된 문항을 저장하는 문제 은행 데이터베이스로 구성된다. 문제은행 데이터베이스는 특정 학습자 또는 특정 학습에 대한 문항을 선택하는 문항 선제부, 특정 학습자 또는 특정 학습에 대한 문제지를 제작하는 문제지 제작부, 문제지를 저장하였다가 온라인 테스트를 수행할 때 출력하는 문제지 은행 데이터베이스를 포함한다. 학습자가 온라인 테스트에 제출된 문항들에 대한 문항 선택순서, 보기 선택순서, 클릭회수, 반응시간에 대한 평가 데이터를 수집하는 온라인 테스트부, 및 온라인 테스트부로부터 수집된 학습자의 온라인 테스트 평가 데이터를 분석하여 학습자의 학습수준과 학습능력, 성향을 평가하고 진단하여 보고하는 반응패턴 분석부를 포함한다. 제안하는 시스템은 보기 선택순서, 클릭회수, 반응시간을 학습자의 평가결과에 반영하여 효율적으로 학습자의 학습수준과 학습능력, 성향을 평가하고 진단할 수 있다.

• 의학교육논단
• /
• 제20권1호
• /
• pp.20-31
• /
• 2018

Good assessment is crucial for feedback on curriculum and to motivate students to learn. This study was conducted to perform item analysis on the Medical Education Assessment Consortium clinical knowledge mock examination (MEAC CKME) (2011-2016) and to evaluate several effects to improve item quality using both classical test theory and item response theory. The estimated difficulty index (P) and discrimination index (D) were calculated according to each course, item type, A (single best answer)/R (extended matching) type, and grading of item quality. The cut-off values used to evaluate P were: >0.8 (easy); 0.6-0.8 (moderate); and <0.6 (difficult). The cut-off value for D was 0.3. The proportion of appropriate items was defined as those with P between 0.25-0.75 and D ${\geq}0.25$. Cronbach ${\alpha}$ was used to assess the reliability and was compared with those of the Korean Medical Licensing Examination (KMLE). The results showed the recent mean difficulty and decimation index was 0.62 and 0.20 for the first MEAC CKME and 0.71 and 0.19 for the second MEAC CKME, respectively. Higher grade items evaluated by a self-checklist system had better D values than lower grade items and higher grade items gradually increased. The preview and editing process by experts revealed maintained P, decreased recall items, increased appropriate items with better D values, and higher reliability. In conclusion, the MEAC CKME (2011-2016) is deemed appropriate as an assessment to evaluate students' competence and prepare year four medical students for the KMLE. In addition, the self-checklist system for writing good items was useful in improving item quality.

• Current Research on Agriculture and Life Sciences
• /
• 제26권
• /
• pp.7-15
• /
• 2008

This research is significant in terms of estimating the validity by setting evaluation items in view of integrating not only original beauty and visual areas but also natural ecological areas based on questionnaire. The results are as follows. 1) According to literature study, 17 items such as variety, the character of sites in terms of landscape, the beauty of landscape, visibility, and ratio of green visibility are selected. Also, 21 items such as variety of animals and plants species, size of green area, and ecological naturalness are selected in the area of landscape ecological resources. 2) As a result of questionnaire of the group of landscape experts, animals and plants ecological areas show 5.6341, the highest in importance analysis according to assessment areas. Also, as a result of importance analysis on items in each area, for example, in the area of visual resources, the item of skyline analysis is 6.0488, the highest. 3) As a result of corelation of item meaning on landscape effect assesment, for example, meaningness of psychological assessment item and landscape site item indicate 0.710, the highest coefficient correlation. 4) As critical assessment items per unit project, items such as damage minimization of original land features for project in terms of point, ratio of green visibility, variety of animals and plants species marked above 8.0 as high important medium. The project in terms of line, minimization of original land features, preservation of worthy biotope showed high point and the character of sites in terms of landscape, minimization of original land features, the size of green area, and analysis of skyline marked above 8.5 as high importance points. On the contrary, items for climate and soil showed relatively low points.

• 한국정보과학회논문지:컴퓨팅의 실제 및 레터
• /
• 제16권10호
• /
• pp.1010-1014
• /
• 2010

잡지기사 관련 상품 연계 추천 서비스는 온라인 상에서 잡지 가사의 컨텍스트를 반영하여 상품을 추천하는 서비스이다. 현재 이러한 서비스는 잡지기사와 상품에 부여되어 있는 태그 간의 유사성을 기준으로 한 추천 기술에 의존하고 있으나, 태그 부여 비용과 추천의 정확도가 높지 않은 단점이 있다. 본 논문에서는 잡지 기사 컨텍스트 관련 상품연계 추천 기술의 한 요소로서 상품이미지 정보로부터 상품의 종류를 자동으로 분류하고 이를 상품의 태그로 활용하는 방법을 제안한다. 이미지에서 추출한 시각단어(visual word)와 상품 종류 간의 고차 연관관계를 하이퍼네트워크 기법을 통해 학습하고, 학습된 하이퍼네트워크를 이용하여 상품 이미지에 한 개 이상의 태그를 자동으로 부여한다. 실제 온라인 쇼핑몰에서 사용되는 10 가지 종류의 상품 1,251개의 이미지 데이터를 기반으로, 하이퍼네트워크 이용한 상품이미지 자동 태깅 기법이 다른 기계학습 방법과 비교하여 경쟁력 있는 성능을 보여줌과 동시에, 복수개의 태그 부여를 통해 상품 이미지 태깅의 정확성이 향상됨을 보인다.

• 한국학교ㆍ지역보건교육학회지
• /
• 제15권3호
• /
• pp.105-125
• /
• 2014

Background: The purpose of this study was to evaluate reliability and validity of a 27-item Korean Version of the Impact of Weight on Quality of Life in adolescents ($IWQOL-Kids^{(C)}$: Korean Version). Methods: This instrument was administered to 872 adolescents (mean z-BMI: 2.61, mean $age{\pm}SD$: $13.9{\pm}1.2$, male: 51.9%). Reliability was tested by internal consistency method and item analysis, validity test was performed by index of content validity, exploratory factor analysis, confirmatory factor analysis and concurrent validity. Sensitivity was tested by ANOVA and t-test. Analyses were performed using SPSS and Amos 18.0. Results: By an exploratory factor analysis, 4 factors were extracted; 'Body esteem' consisted of 9 items with 35.9% of variance (social life: 6 items, 10.23%, physical comfort: 6 items, 8.21%, family relations: 6 items, 7.0%). Four factors explained 61.34% of total variance. Internal consistency coefficients ranged from .766 to .929 for scales on 27 items and equal to .920 for total score for both the 26-item and 27-item tools. A confirmatory factor analysis was conducted for the convergent validity and discriminant validity. The standardized factor loadings to test the convergent validity showed more than .5(C.R<1.965) on all paths after deletion of item PC1 (avoid stairs). The average variances extracted were more than .50 and the construct reliabilities were more than .70. The average variances extracted were stronger than the squares of correlation coefficient of inter-latent variables. Conclusions: These results support that the $IWQOL-Kids^{(C)}$: Korean Version with a 26-item is a reliable and valid tool in Korean obese adolescents.

• 한국콘텐츠학회논문지
• /
• 제19권8호
• /
• pp.293-302
• /
• 2019

이 연구의 목적은 Stroke Impact Scale 3.0(SIS 3.0)의 신뢰도와 타당도를 조사하는 것이었다. 연구에서 SIS 3.0은 125명의 뇌졸중 환자를 대상으로 측정하였다(평균 = 62.7, 표준 편차 = 9.43). SIS 3.0 하위 영역들 간에 상관 분석을 통해 구성타당도를 확인하였고, MBI(Modified Barthel Index)와 K-MMSE(Mini-Mental State Examination-Korean)간의 상관을 분석하여 수렴타당도를 조사하였다. 각 항목의 특성은 고전적 문항 이론을 바탕으로 내적 합치도와 문항 변별도를 분석하였다. 이 연구를 통해 SIS 3.0의 구성타당도와 수렴타당도가 확인되었다. 감정 영역에 포함된 i 항목은 문항 변별도가 낮았지만 이 항목을 제외하고는 모두 변별도가 높았다. 하위 영역의 문항내적합치도는 0.858~0.941로 나타났다. 이 연구는 지역사회에 거주하는 뇌졸중 환자를 대상으로 임상 현장에서 SIS 3.0 사용을 위한 신뢰도와 타당도를 확인하였다는데 그 의의가 있다.

• Psychiatry investigation
• /
• 제15권11호
• /
• pp.1053-1063
• /
• 2018

Objective This study evaluated the psychometric properties of the Korean Anxiety Screening Assessment (K-ANX) developed for screening anxiety disorders. Methods Data from 613 participants were analyzed. The K-ANX was evaluated for reliability using Cronbach's alpha, item-total correlation, and test information curve, and for validity using focus group interviews, factor analysis, correlational analysis, and item characteristics based on item response theory (IRT). The diagnostic sensitivity and specificity of the K-ANX were compared with those of the Beck Anxiety Inventory (BAI) and Generalized Anxiety Disorder 7-item scale (GAD-7). Results The K-ANX showed excellent internal consistency (${\alpha}=0.97$) and item-total coefficients (0.92-0.97), and a one-factor structure was suggested. All items were highly correlated with the total scores of the BAI, GAD-7, and Penn State Worry Questionnaire. IRT analysis indicated the K-ANX was most informative as a screening tool for anxiety disorders at the range between 0.8 and 1.6 (i.e., top 21.2 to 5.5 percentiles). Higher sensitivity (0.795) and specificity (0.937) for identifying anxiety disorders were observed in the K-ANX compared to the BAI and GAD-7. Conclusion The K-ANX is a reliable and valid measure to screen anxiety disorders in a Korean sample, with greater sensitivity and specificity than current measures of anxiety symptoms.

• 대한치위생과학회지
• /
• 제3권2호
• /
• pp.1-8
• /
• 2020

This study investigated the relationship between oral health knowledge, behavior and orthodontic satisfaction in orthodontic patients visiting dental hospitals and clinics and provided suggestions to improve orthodontic patients' satisfaction. This study anayzed structured self-administered questionnaires collected from 245 patients who visited 5 dental clinics in Gwangju Metropolitan City. Regarding oral health knowledge, the highest percentage of correct answers was for the item "Cavities heal themselves over time" (97.1%), and the lowest percentage of correct answers was for the item "Cavity bacteria move from tooth to tooth" (16.7%). Five fluoride items showed a lower percentage of correct answers than those for cavity and gingival diseases. Regarding the survey on oral health behavior, the highest score was found for the item "I brush my teeth with a certain method and order" (3.78 out of 5), and the lowest score was found for the item "I use an electric toothbrush" (1.34 out of 5). Regarding the survey on orthodontic satisfaction, the highest score was found for the item "I would recommend receiving medical treatment at the department of orthodontics" (4.23), and the lowest score was found for the item "Orthodontic cost is reasonable" (3.46). While oral health behavior had on orthodontic satisfaction, oral health knowledge had no effect on it. Oral health behaviors should be improved to enhance orthodontic satisfaction. To improve oral health behavior, it is necessary to develop and activate education programs for tooth brushing and oral care for orthodontic patients.

• 한국임상보건과학회지
• /
• 제8권2호
• /
• pp.1426-1435
• /
• 2020

Objective: This study aims to develop CFT, a screening test for dementia that can be conducted on patients with mild cognitive impairment or early dementia. Methods: This study was conducted on therapists working at occupational therapy hospital in Gyeongsangnam-do. The data collection period is two months from July to September 2020, and the research participants were briefed on the purpose, significance, and anonymity of the research in consideration of ethical issues. A total of 33 copies of the data were finally analyzed, excluding those containing insufficient answers and errors, by distributing 40 copies of the data. SPSS Data Access pack 8.0 was used for data analysis, Cronbach's α value was evaluated for internal consistency reliability of each item, and Pearson Correlation coeffient between the lower scales of the assessment tool was measured. Results: The Cronbach's α value of the CFT was shown as .892 and the reliability of the assessment paper was shown to be quite high. The Cronbach's α value for each item in the cognitive assessment tool was the highest at .899 in the subtraction item, with exercise control (mook Chi Pa) at 888, visual memory, plus .887. The correlation of each item of cognitive assessment tools was found to be most correlated with the number of sustained concentrates and word2 to .934; in the stop word-numeric item and visual memory to be .85; and in the addition to the auditory memory item .739. Conclusion: Therefore, this study developed cognitive evaluation tools that can distinguish the diversity and cognitive level of screening tests and clarify standards, which are different from the existing dementia screening tools in Korea. Furthermore, the cognitive assessment tools of this study can be verified by applying them to patients with mild cognitive impairment and early dementia, and the criteria for generalization can be established.

• 한국전문물리치료학회지
• /
• 제28권2호
• /
• pp.146-153
• /
• 2021

Background: Researchers have previously commenced examining the degree of concordance between parent proxy and child self-reports on health-related quality of life (HRQOL) of many disease and impairment populations. Objects: To explore the differences between parent proxy and child self-reports on the HRQOL using Korean version of KIDSCREEN-10 questionnaires for applying to elementary school children and their parents who participated for a school-based wellness program. Methods: The focus groups were recruited for a school-based wellness program by implementing the following wellness services: 1) referring to a screening session for detecting potential posture-related musculoskeletal problems and 2) recommending home exercise programs. Before a primary field testing for the program, two focus groups were formed with a group of 9 parents and their 9 elementary school children aged 8-10 years of age. The parent proxy and child self-report versions of KIDSCREEN-10 questionnaires were administered to both groups after completion of the wellness program. Item level Rasch rating scale analysis was applied to compute logit scales of KIDSCREEN-10 questionnaire. Intraclass correlation coefficients (ICCs) and scatterplot of item difficulty between two reports were analyzed. Results: For fit statistics of parent proxy report, all items except 4 items (i.e., psychological well-being, mood/emotions, self-perception, parent relation) were found to be acceptable. For fit statistics of child self-report, all items except 3 items (i.e., psychological well-being, autonomy and home life) were acceptable. The relationship between two reports using ICCs were ranging from weak to very strong at p = 0.05 (i.e, ICCs = 0.011 to 0.905). Scatterplot analysis between two reports showed a major disparity on self-perception item at 95% confidence intervals. Conclusion: Both item level analyses and ICC comparisons provided a disparity between parent proxy and child self-reports of the HRQOL on self-perception item after competing a school-based wellness program. Therapist should consider the item as part of the HRQOL assessment.