• Journal of Engineering Education Research
• /
• v.20 no.4
• /
• pp.21-27
• /
• 2017

The purpose of this study is to provide basic data and guideline to STEM(Science, Technology, Engineering, Mathematics) educators who prepare engineering education in elementary and secondary school. For this, this study develops a composition model for engineering education program of elementary and secondary school. To do this, a literature research, experts interview and Delphi survey were conducted. Through the literature research, we extracted the components of model for engineering education program of elementary and secondary school and then made a first draft of the model. The draft was revised by experts while Delphi survey was used to validate the model based on Delphi panels' opinions. The panels for the Delphi survey consisted of 51 experts in the STEM education field. The survey was conducted three different times and importance survey was included in the third stage. The conclusions of this study were as follows: First, the model consist of definition, 4 directions, 4 characteristics, 3 educational goals according to school level, educational contents area and element, teaching and learning method and evaluation method. The educational contents area and element consist of 2 major areas, 7 areas and 18 elements. Second, all components of the developed model were valid in most of the statistics such as mean, standard deviation, the degree of consensus and convergence, and CVR(Content Validity Ratio). Third, importance for education contents area and element according to the school level are analyzed.

• Journal of People, Plants, and Environment
• /
• v.23 no.4
• /
• pp.433-443
• /
• 2020

Background and objective: The boom in urban agriculture has also resulted in the creation of many school gardens. With the increase in various hands-on education programs, people are interested in assessing the value of school gardens. This study was conducted to derive indicators for service value assessement of educational farming experience using school gardens. Methods: Through literature review, we selected assessment items and sub-factors. The indicators for evaluating the effectiveness of school gardens are classified using the Delphi method that involve a focus group experts. In order to increase the reliability and validity of the selected and classified items, an exploratory factor analysis was conducted. In addition, the relative importance and priority of each factor in each field were assessed using the analytic hierarchy process (AHP). Results: We classified the indicators into 4 criteria and come up with 13 items and 33 sub-factors in educational value, health value, economic value, and ecological and environmental value. Most of the items for the 4 value criteria derived were significant for assessing the value of agricultural experience services with content validity ratio (CVR) higher than 0.59 and reliability higher than .6 . In the value criteria, the experts rated educational value as the most important, followed by health value, ecological and environmental value, and economic value. In the assessment items, the most important was improvement of social functions. In the sub-factors, the most important was strengthening of ties (friendly interactions). Conclusion: Among the derived indicators assessing the value of school gardens, 4 criteria, 12 evaluation items and 29 sub-factors showed significance. The schematic index would be useful for the assessment.

• Journal of Nutrition and Health
• /
• v.53 no.2
• /
• pp.175-189
• /
• 2020

Purpose: This study was conducted to develop, validate, and assess the reliability of a questionnaire for nutritional literacy among young Korean adults. Methods: The draft questionnaire contained 65 items in 7 domains (i.e., dietary guideline, nutrition and health, nutrients, 5 food groups [food bicycle], nutrition labeling, portion size, and nutrition management for disease prevention). The authors developed a draft questionnaire based on a literature review. After multiple drafts, 52 items were retained and 13 were eliminated in the 7 domains according to professional advice from 5 nutrition experts. A panel of experts (n = 20) comprised of clinical dietitians and nutrition professors completed the content validity assessment, including quantitative and qualitative feedback. As the results, all items of the portion size were eliminated from the questionnaire. A sample of 211 young adults completed the test-retest reliability assessment. Test-retest reliability was evaluated using intra-class correlation coefficient (ICC) and inter-item reliability by Cronbach α coefficient. Results: The final questionnaire contained 30 items with 5 questions each on the dietary guideline, nutrition and health, nutrients, 5 food groups (food bicycle), nutrition labeling, and nutrition management for disease prevention. The Lawshe content validity ratio for domains ranged from 0.60 to 1.00. The ICC scores for questions ranged from 0.64 to 0.86. Cronbach's α for domains ranged from 0.83 to 0.90 and for the overall questionnaire was 0.87. Conclusion: The questionnaire showed strong content validity, test-retest reliability, and high inter-item reliability, indicating that it is a useful tool for assessing nutritional literacy of young adults.

• Journal of Gifted/Talented Education
• /
• v.24 no.5
• /
• pp.807-827
• /
• 2014

The purpose of this study was to extract and validate the educational goals and the subjects for developing a music gifted curriculum. Based on literature review and analysis of music gifted curricula in foreign countries, 19 educational goals and 18 subjects were derived from literature review and analysis of music gifted curricula in foreign countries. To validate the educational goals and the subjects, delphi survey was carried out twice with 26 expert panelists in the field of music, music education and music gifted education. Delphi survey was analyzed using the mean, content validity ratio, and the degree of consensus. The final set of educational goals for music gifted education included 6 skills related goals, 4 creative expression related goals, 4 knowledge related goals, and 2 attitude related goals. The final set of subjects included 4 major-specific subjects, 5 foundational subjects, 4 theory-related subjects, 3 integration and social participation related subjects. The results of this study can be used as baseline data to develop a music gifted curriculum by providing ideas for deciding what to teach and why to teach in music gifted education.

• 대한공업교육학회지
• /
• v.33 no.2
• /
• pp.97-119
• /
• 2008

The purpose of this research is to clarify the elements of the function of the role of industrial high schools that its experts perceived. The content of this research is verify the function element required for the performance of the role of specialized education through content validity ratio(CVR). This research adopted the method of literature research and Delphi method, which is to collect and come to an agreement of the opinions of the 26 research panels. The first round is constructed by the semi-constructed questionnaire for the analysis of the opinions of the panels by inductive method. The second round is to categorize the result of the first one into 7 domains, and asked each category by Likert's 5 scale checklists, and statistically analyzed mean, medium, standard deviation, and quartile. The third round is to statistically analyze Mean, standard deviation, medium, and validity ratio(CVR) to reassure the opinions of the panels on the basis of the result of the first one. The categorized contents of the function required for the performance of the specialized education in this research is 'in-service visit and in-service training', 'licence acquiring education', 'employment counseling and job employment information', 'custom-made education connected with industry', 'career education' and 'enhancement of basic career competency'. The panels are divided into professors, teachers, professionals, and policy administrators, and they verified the validity rate of the function role and priority of emphasis. The result showed that the tendency of the education is converting from physical function-centered education to education of emotional attitude and competence of thought.

• Journal of Nutrition and Health
• /
• v.50 no.1
• /
• pp.111-119
• /
• 2017

Purpose: School meal programs should be part of the educational process to promote good eating habits for students. The purpose of this study was to develop an evaluation scale for educational school meal programs and evaluate the achievement level of educational school meal programs using the developed scale. Methods: The evaluation scale for educational school meal programs consisted of 23 items in eight categories and was developed using content validity ratio (CVR) analysis and analytic hierarchy process (AHP) by 15 related experts. The results of a survey on nutrition teachers or dietitians at 91 elementary, middle, and high schools in Gyeonggi province, South Korea were analyzed to evaluate the achievement levels of educational school meal programs. Results: Overall, total average score was 45.7 out of 100, with significant differences among schools (p = 0.005). Elementary schools (51.9) showed a higher average score than middle (41.5) and high schools (37.1). The score for the category of regular nutrition and dietary education was the lowest (5.7 out of 33.7). In addition, school meal environment (5 out of 10), educational activities through school meal time (9.2 out of 19), and extra-curricular experiential activities (3.5 out of 10) also showed inadequate levels. Conclusion: The results show that the overall level of educational school meal programs is not adequate and needs to be improved, especially at middle and high schools. Government support polices need to be implemented to encourage educational activities related to school meal programs.

• Journal of Korea Entertainment Industry Association
• /
• v.14 no.7
• /
• pp.529-538
• /
• 2020

This study aims to develop of contents for the activities of daily living training - Korean version that reflexes the domestic situation and can be applied to clinical practice. For contents development, a Delphi survey was conducted with 13 experts. In the first Delphi survey, 133 items of activities of daily living training are derived based on previous studies, and then the extracted items are asked to group of experts, and the derived items are answered for actual domestic clinical application. In the second survey, 118 items were added by excluding items with a low content validity ratio (CVR) including the results of the first survey, and adding items that can be derived from other opinions. In the 3rd survey, while presenting the 2nd Delphi survey items as they are, it provides an opportunity to change their opinions by presenting their 2nd response and the 2nd average score of other expert panels, and adding appropriateness and importance together. The data were analyzed to obtain the mean, standard deviation, interquartile range, CVR, convergence, and consensus. Finally, a total of 69 items were selected and 49 items were excluded so that 105 items for CVR 0.54 or higher, 111 items for convergence degree 0.50 or lower, and 70 items for continuity degree 0.75 or higher. Sexual activity, care of others, care of pets, and child rearing are difficult to apply socially and culturally, driving and community mobility cannot be performed within the clinical room, and home establishment and management may have different roles depending on gender, and religious spiritual activities and expression are so personal. For these reasons, these items were found to have low importance or suitability. This study can be usefully used as an indicator on the activities of daily living training - Korean version in clinic or community setting.

• Journal of Gifted/Talented Education
• /
• v.23 no.2
• /
• pp.193-213
• /
• 2013

The purpose of this study was to develop and validate the evaluation criteria for gifted curriculum in visual arts. For this purpose, a draft of evaluation criteria for gifted curriculum in arts were first developed through literature review and opinions of experts in educational assessment, gifted education, visual art education. Then, the Delphi method was employed to validate the evaluation criteria. Delphi survey was carried out twice with 30 panelists consisting of experts in educational assessment, experts in gifted education, experts in arts(gifted) education and administrators in gifted education. Delphi survey was analyzed using the mean, content validity ratio, and the degree of consensus. Results were as followed. First, 58 evaluation criteria for gifted curriculum in arts were developed through literature review and expert opinions. The evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 12 process evaluation criteria, and 9 product evaluation criteria. Second, through the first and second Delphi survey, 2 evaluation criteria were not validated and finally were removed. The final evaluation criteria included 12 context evaluation criteria, 25 input evaluation criteria, 10 process evaluation criteria, and 9 product evaluation criteria. The evaluation criteria developed by this study can be used as a standard to establish the institution assessment system at the national level and evaluate institutions and programs.

• Asia pacific journal of information systems
• /
• v.19 no.1
• /
• pp.63-82
• /
• 2009

Virtual community is a social aggregation to attain some goals in an IT-supported virtual space (Lee et al., 2002). As lots of virtual communities generate robust and reliable outputs with low control and low incentive, previous researchers was interested in the questions, "why do they participate?" or "how are they controlled?". But. as Katz (1964) said, the most important part of the high-performing organization is the behaviors of members in the organization. Therefore, this research is to examine the relationship between the performance and the behaviors of participants in the virtual community. First, we propose 6 types of behaviors related to high performance in the virtual community: 'Continuous Attendance', 'Complying with the organizational value, policies, and regulations', 'Protection', 'Suggestion for the improving', 'Self-training', and 'Favorable behavior'. The six types of behaviors are extracted from the framework of Katz (1964) and Brief and Motowidlo (1986). The reason why each behavior is positively related with high-performance is that those who continuously attend have more responsibility than temporary participants do; complying with the rules of a virtual community means that they may make more reliable outcome; 'Protection' is one of the prosocial-behaviors and those who protect the community may concern the benefit of the virtual community when they participate: those who suggest some ideas for improvement may contribute to the virtual community; 'Self-training' behavior means that participants really want to have high quality in their contribution: those who have 'Favorable attitude' consider other members in the virtual community when they participate. Then, we perform an empirical analysis with the survey from participants in the Knowledge service of Naver.com, to show those behaviors are associated with the high-performance. To make the measurement for the six behaviors, we use CVR (content validity ratio) method (Lawshe, 1975), interviewing 12 experts. The dependent variable, performance of participation, is measured by 'ratio of selected answer' given by the Naver.com. We use email survey. We sent 1200 emails to randomly selected participants in the knowledge service and received 282 responses. The results of our empirical analysis show that 4('Continuous Attendance', 'Suggestion for the improving', 'Self-training', 'Favorable attitude') are positively related to the performance, but 2('Complying with the organizational value, policies, and regulations' and 'Protection') are not significant. In line with Fitzgerald (2006), we expect that participants in the virtual community may behave similarly to employees in the off-line firms for the high performance. But 2 behaviors have different results. The reason that the 'Complying with the organizational value' behavior is not sufficiently related to performance is that the motivation of participants is more related to intrinsic pleasure or altruism than external reward. Also, the 'Protection' behavior has no significant relationship with performance, which means that the high-performing participants have little concern about the problems in the community.